|
|
|
|
|
by coldtea
1161 days ago
|
|
>Except we can't tell 1 ms of time passing from 2 ms. So? We can still tell 1 munute from 1 second. >An LLM's temporal resolution is certainly worse, on the order of minutes to months, but not fundamentally different. At the moment it's not just slower, it's zero, cause they don't keep state of what they do as part of their training iirc. |
|
LLMs have a context window, as it would be impossible to carry on a conversation with them without it. They can answer questions about when some event in that conversation happened relative to other events in it. GPT4's 32K tokens isn't human capacity, but it's not zero.