[BearOso]

The knowledge how to program on old systems like the NES is located sparsely on the Internet and there aren't many coding examples. A LLM would have a very difficult time producing a cartridge ROM with no single-byte errors. Even multiple iterations wouldn't iron out the errors. The closest thing you could do would be construct a template and have the LLM fill in the graphics or text, but that's not versatile at all.

[ilaksh]

As far as not being able to produce machine code without even a single byte error of consequence, true, it's questionable whether that's possible. But I'm not sure that is proven impossible with LLMs? So I think it's worth testing it.

I was thinking of training it on all of the 6502 compatible machine code that's out there. There are at least 20,000 or 30,000 programs.

[pyinstallwoes]

Seems possible with LORA versions of them like stable diffusion uses it for modular recombination.