[latentsea]

I am saying 3 years ago there wasn't a snowballs chance in hell I could one shot a playable Minecraft clone, and there has never been a snowballs chance in hell a human developer could do so in 45 minutes.

The difficulty of the task and human performance on that task hasn't changed. LLMs performance on that task has changed dramatically.

[8note]

it could almost certainly regurgitate something like minetest

its in the training data, probably many times, and it was then, too

[latentsea]

And that's exactly why 3 years ago we saw people one shotting it in 45 minutes :)

[staticman2]

"Some idiot on Twitter did a game tech demo" has been a thing since, like GPT 3.5 or 4.0?

[latentsea]

It has. We can see 3.5 started with text adventure games https://medium.com/@duncanariey/using-chatgpt-to-make-the-it... and with 4.0 it moved up to pong https://x.com/skirano/status/1635736107949195278

As the generations increase, so too has the complexity of the games it can one-shot.

[staticman2]

But nobody has nailed "this is a game anyone wants to play" or "professional game development life cycles are shorter" so it's not particularly impressive.

I'm still waiting for any evidence of LLM economic impact in the real world.

[latentsea]

Yeah, well I doubt any economic impact will from LLMs will ever come. I doubt anyone is working on nailing those things as we speak. I doubt the results my team and I are getting with agentic engineering are real. I doubt anyone can take increasingly better tools and translate that to economic value.