[m3kw9]

If you train a LLM to compile, you probably also want to set the randomness to zero, if that is the case you’ve just “brute forced” an actual compiler

[danielmarkbruce]

you don't want a creative compiler?

[fxcao]

In this specific use case I think we should avoid any creative aspect in the behavior of the LLM. Compiling might look like a "word-for-word" translation in a certain manner. Isn't it ?

[layer8]

I see no inherent conflict between creativity and determinism. You could give the compiler a seed value to perturbate the solution space.

[m3kw9]

Why vote down a rhetorical question?