|
|
|
|
|
|
by orbital-decay
42 days ago
|
|
|
Yes, that's my entire point and I'm well aware about LLM internals. Reread the comment above, I'm responding to a person who suggested to increase the context window of an LLM to make it less different, saying it will never work. |
|
|
My read of it was "this is why humans are fundamentally different from LLMs", not "this is how you fix LLMs to be like humans".
It's still hard to see how you can argue that humans' "context window", looked at in even a vaguely similar manner to that of LLMs, is tiny.