[athrowaway3z]

I actually think there is a second level to this. Yes HTML will get you most anywhere, but I found that letting the LLM define its own language is also unreasonably effective.

Currently working on a dumb little mobile game with isometric view and sound:

- told codex to write a tool that lets its place blocks in a prepared three.js document and have chromium dev tools take a screenshot. It made up a little JSON structure that defines blocks / colors and some other effects and it outputs 2.5d tilesets.

- told it to create a uv python script that would let it define sounds and music, and it made a yaml format that lets it create noises.

We completely shot past the svg pelican test. Codex has created both perfectly adequate prototype art of soldiers/knights/priests as well as a prototype soundtrack.

[BobbyJo]

LLMs do fantastic when you do the architecting for them. Don't let them make system decisions, and you'll have a great time.

[le-mark]

This sounds very intriguing have you written more about it anywhere we can read?

[bitexploder]

They can map things like this. They are amazing translation layers. As long as it is a shape of problem or data they are trained on they can translate. The DSL they made up is shaped like some other data format they know for that latent space. It seems amazing, and it is, but it is also a core feature of how LLMs work. The problem is it works until it doesn’t. Fuzzy can only get you so far before it decoheres without rigor.