[david-gpu]

> LLMs don't have an internal representation of "facts", they generate text based entirely on the conversation history.

If output only depended on the conversation history, you would get the exact same output if you started ten conversations in the exact same way, and that doesn't happen.

LLMs encode their knowledge in their parameters, which are fixed after training is complete and thus well before the conversation begins. The context of the conversation does also affect the output you get from the LLM, because by design they take context into account, but it is entirely untrue that the output is "they generate text based entirely the conversation history".

[tech_ken]

Sure I guess I meant "entirely on the conversation history" in the sense that a prompt is a sin qua non of an outcome, and the outcome is dependent on the specific prompt(s). I was using the word informally as an emphasizer of "conversation history", did not intend to imply that it didn't have parameters or other internal things which effected the output, just the output at any given point in time is path-dependent on the prompts you put.