Hacker News new | ask | show | jobs
by kingsleyopara 703 days ago
The biggest win here has to be the context length increase to 128k from 8k tokens. Till now my understanding is there hasn't been any open models anywhere close to that.
2 comments
HanClinto 702 days ago
It is notable, but it's not alone. Mistral NeMo just released last week with a 128k context window:

https://news.ycombinator.com/item?id=40996058

link
kingsleyopara 702 days ago
Thanks! Not sure how I missed that :)
link
HanClinto 702 days ago
It's easy to miss things. Trying to keep up with the latest in AI news is like drinking from the firehose -- it's never-ending.
link
cpursley 702 days ago
Phi 3
link