Hacker News new | ask | show | jobs
by Wronnay 1116 days ago
Wow. I keep a personal Wiki, Journal and use plain text accounting...

This project could help me create a personal AI which answers any questions to my life, finances or knowledge...

1 comments

Well maybe it works on Obsidian vaults for note taking heh, but with llama models' 2k input token range it'd get a tenth of the way before starting to drop context. Likely useless without something like an 100k model.
Well you wouldn't input the whole Vault to the model, you would use embeddings to find the content that is most relevant to the question being asked.
Is that actually a thing yet? Proper vector DB integration? I sure would like to see some demos of that, as it's been hyped up a lot but I haven't really seen anyone deploy anything proper with it yet.
Even PrivateGPT does that, using Chroma as vector DB