[xdertz]

> LLMs can be described as "hardcoded weights for generating the next token". All code is "hardcoded".

I disagree. Hardcoded means you need to change and recompile the entire program. So neither an .env file nor model weights that are loaded at runtime are 'hardcoded'.

[trashb]

But you can use hardcoded while referring to interpreted languages as well, it's a bit of a difficult term. I feel it's more about repeatability when non of the input changes.

I would define it more broadly, "same input == same output, with the same program" and using that definition all computer programs are hardcoded in the end.

There is a gray area, you can consider that even programs that use random() are in the hardcoded category as with the same (semi)random value they will produce the same output. You just need to think of the random value as input, since not all input needs to be user input.

[rootlocus]

Sure, and the article mentions the AI in elden ring is scripted in lua which is loaded at runtime, meaning it's not hardcoded.