Hacker News new | ask | show | jobs
by kbrisso 325 days ago
I chunk the documents and use Elasticsearch to store the vectors. On a laptop with 8GB of GPU I can have a pretty large context window and not hallucinate.
1 comments

Nice! Will have to give it a go, looks interesting. Thanks for sharing.