Hacker News new | ask | show | jobs
by harveney 8 days ago
Thanks for the reply! So you've actually built your own custom vector DB on top of the memory layer? That's definitely something new.

I'm honestly not sold on memory layers as a whole, I find that adding more context only serves to make the LLM's dumber and I've been slowly leaning towards just having no memory and working on features in isolation.

You've done benchmarks already so that's another step in the right direction, do you find that these benchmarks are good indications of practicality? Have you seen a major difference in LLM performance utilizing this as a memory layer?

1 comments

To answer your first question, I have to say no. agentic memory benchmarks do not reflect the nuances and difficulties that real agents encounter in real workflows. We hope there are better more practical benchmarks being developed. Second question I assume by LLM you mean AI agents; if that is the case, yes, the whole agentic work experience is different when you have an active memory agent to rely on.