Hacker News new | ask | show | jobs
by behnamoh 928 days ago
> The better the modelling of the real world problem is, presumably the better the fidelity of the simulation.

But that's exactly my concern: LLMs are known to hallucinate. How can we make sure the simulated agents are acting like actual humans? It can't be just a "cool" tool you add to your company arsenal; it must actually provide some value.

3 comments

> But that's exactly my concern: LLMs are known to hallucinate. How can we make sure the simulated agents are acting like actual humans?

You can set up and run simulations and validate them (and then tweak the configuration to tune them).

But a starting point for all that is having a framework for running the simulations, which is what this is.

Well, idk. But like any approximation I guess you can check if it fits prior controls better than your existing models. It's not like existing stuff is necessarily better.

I have no horse in this. You just asked for explanations of what their project is about. It seemed obvious to me so I took a stab at providing context.

The hallucination may not be a bug but a form regularisation that will helps sample behaviour and that itself might be of great use as it might act as a proxy for focus groups