Hacker News new | ask | show | jobs
by kittikitti 110 days ago
This is a good rule of thumb. I would also include that in most cases, RAM use exponentially increases with context window size.
1 comments

There's zero exponential scaling involved. There is quadratic compute and reasonably log-linear storage, though.