Hacker News new | ask | show | jobs
by cathalc 757 days ago
Absolutely. Gemini results tend to drop off after 128k tokens according to RULER: https://github.com/hsiehjackson/RULER
1 comments
ayyndrew 757 days ago
If I'm reading the paper right, it says Gemini 1.5 is good up to 128k, and RULER doesn't test beyond 128k
link
cathalc 756 days ago
Hmm perhaps you are right.. There's no context on the page about what ">128k" means so possibly a bad assumption on my part!
link