[forrestthewoods]

> Are you sure?

Absolutely.

Current LLMs have insufficient world state. Imagine a game like Stardew Valley. It's got a town with 30 NPCs or some such. They all have personalities and the player builds a relationship with them over time. Current LLMs can't do that. They hallucinate waaaaaaay too much. You can't reliably define and evolve relationships. Amongst many other short comings.

I'm super pro AI and use ChatGPT all the time for programming. So I'm not being an AI hater. But I am a gamedev and I can say that what exists today simply isn't good enough.

[Tiberium]

But you're saying that you want a single model to handle all NPCs and the whole world. Of course this isn't possible currently. But using a separate model with separate context for each character is. Also, if you use ChatGPT for programming, try Claude 3.5 Sonnet - it's really better than GPT-4o for programming.

[forrestthewoods]

> But you're saying that you want a single model to handle all NPCs and the whole world.

No, I did not say that at all. I didn't specify how the LLMs may or may not be structure. I'm saying that current LLMs - and yes I've used Claude 3.5 Sonnet - are insufficient. There is no existence proof that they're sufficient.

LLMs are great. They aren't great enough for video game NPC. Not yet. Further innovation is needed. You're free to disagree. I can't prove a dispositive. But there is no working example.

[ebalit]

As a gamedev, what would you use currently instead for NPCs? And what would you say makes this/those solutions better than LLMs?

[forrestthewoods]

Dialogue systems vary by game and are generally custom. But they amount to hard coded if-else branches if you squint. The only one I ever wrote was a simple announcer for a sports-ish shooter.

Your question is weird. Every video game ever made has shipped using not LLMs. Not a single commercial game has ever shipped with an LLM. So I’d say what makes classic NPC systems better is they’ve shipped tens of thousands of commercial successes over 50+ years. And what makes LLMs worse is they haven’t once been proven viable for even a single title. Nor have they produced even a compelling tech demo.

Geez people.

[ebalit]

My question was genuine as I'm not from the gamedev domain and I might have missed the real state of the art.

Hard coded dialogs often feel very unnatural and limiting. I can see why people want to explore LLM to try to make new experiences possible.

I can see it becoming a new dimension of game design, open vs closed dialogs, like there is currently open vs closed world. And as in the open vs closed world, they will probably coexist instead of one type replacing the other.

[Tiberium]

There are multiple games that use LLMs, available in Steam.

[forrestthewoods]

Name them and demonstrate they don’t suck.