Hacker News new | ask | show | jobs
by sigmoid10 83 days ago
We already have that for a while. It works to some degree, but context tokens simply don't offer the level of compression that model weights do. At least with current approaches that keep the context human-readable.