[docheinestages]

Look into FastContext by Microsoft. Not extraordinary but specifically designed for paired usage with a larger LLM to save tokens [1].

[1]: https://github.com/microsoft/fastcontext

[rtcoms]

This may be useful in this context: https://entelligentsia.github.io/is-grep-enough/fastcontext....

[HnUser12]

That repo suddenly seems to have gone missing. I get 404.

[docheinestages]

Oh, I just realized Microsoft removed it a couple weeks ago. I had the link in my bookmarks. The model is available on HuggingFace [1].

[1]: https://huggingface.co/models?sort=trending&search=fastconte...