[xigoi]

> assemblers, code generation, compilers, JIT. Or really, just writing bytes that can represent machine code, P-code, or bytecode.

All of these things have something in common that LLMs don’t. They behave in a predictable, documentable (and usually documented) way.

[trumpdong]

Compiler optimizations are pretty unpredictable.

But you can, in principle, understand a compiler. Also they're made by the same people who use them. Did blacksmiths get mad when they invented the first anvils?

[xigoi]

While optimization may be done in unpredictable ways, it does not (by definition) change the effective behavior of the program. If you write a program to calculate prime numbers, it will always calculate prime numbers, no matter how the compiler optimizes it. If you tell an LLM to write code to calculate prime numbers, you are at the mercy of chance. (Maybe not for such a simple program, where the solution is directly in the training data, but you get the idea.)