Model can accept 1M tokens doesn't mean it can reason across those 1M tokens

Y	Hacker News new \| ask \| show \| jobs

	Model can accept 1M tokens doesn't mean it can reason across those 1M tokens (twitter.com)
	2 points by annjose 20 days ago

1 comments

Looks like there is a memory hierarchy [1] even in LLMs.