Hacker News new | ask | show | jobs
by c0rruptbytes 3 days ago
large contexts degrade the performance - attention doesn't work will for large windows like that and cloud models are kind of hacking it

local models do involve some context engineering to get it okay, but it's not that rough