[ylow]

Author here. Mandala looks really cool. Thanks for the recommendation!

[pgbovine]

also, while i have your attention here, since you wrote that related post on (not) vector db's ... what would you recommend for a newbie to get started with RAG? let's say i have a large collection of text files on my computer that i want to use for RAG. the options out there seem bewildering. is there something simple akin to Ollama for RAG?

[zzleeper]

If you want to get something done quickly, try llama index.

If you want to learn/hack, pick an easy vectordb, get an OpenAI API account, and do a quick attempt

Then you can switch to a local LLM and embedder, and it helps a bit in learning what the pain points are

[pgbovine]

very cool idea! i was also very interested in this problem during grad school ... prototyped an approach by hacking CPython, but the code (python 2.6? from 2010 era) has long bitrotted: https://pg.ucsd.edu/publications/IncPy-memoization-in-Python... https://pg.ucsd.edu/publications/IncPy-memoization-in-Python...