Y
Hacker News
new
|
ask
|
show
|
jobs
by
kittikitti
110 days ago
This is a good rule of thumb. I would also include that in most cases, RAM use exponentially increases with context window size.
1 comments
namibj
109 days ago
There's zero exponential scaling involved. There is quadratic compute and reasonably log-linear storage, though.
link