Hacker News new | ask | show | jobs
by jannniii 112 days ago
Interesting concept, but is it going to age well with context sizes of models are changing all the time (growing, mostly)?
1 comments

max context sizes are probably going to go up, but smaller contexts will always be cheaper/more-efficient than larger ones