Hacker News new | ask | show | jobs
by coldtea 1161 days ago
>Except we can't tell 1 ms of time passing from 2 ms.

So? We can still tell 1 munute from 1 second.

>An LLM's temporal resolution is certainly worse, on the order of minutes to months, but not fundamentally different.

At the moment it's not just slower, it's zero, cause they don't keep state of what they do as part of their training iirc.

1 comments

My point is that we have our limits too in our sense of time. The difference is one of scale and more importantly here, in how it affects the tasks at hand. An LLM is certainly not going to catch a fly ball, but would have no problem tending to plants.

LLMs have a context window, as it would be impossible to carry on a conversation with them without it. They can answer questions about when some event in that conversation happened relative to other events in it. GPT4's 32K tokens isn't human capacity, but it's not zero.