Hacker News new | ask | show | jobs
by hanselot 926 days ago
Couple of years ago 1k context was remarkable.

Now we have public domain models with 200k context.

Soon they will figure out how to fine tune the context in while conversing. Then context is only relevant for the current inference.