Hacker News new | ask | show | jobs
by pgbovine 906 days ago
also, while i have your attention here, since you wrote that related post on (not) vector db's ... what would you recommend for a newbie to get started with RAG? let's say i have a large collection of text files on my computer that i want to use for RAG. the options out there seem bewildering. is there something simple akin to Ollama for RAG?
1 comments

If you want to get something done quickly, try llama index.

If you want to learn/hack, pick an easy vectordb, get an OpenAI API account, and do a quick attempt

Then you can switch to a local LLM and embedder, and it helps a bit in learning what the pain points are