[Atotalnoob]

LLMs CAN be deterministic. You can control the temperature to get the same output repeatedly.

Although I don’t really understand why you’d only want to store prompts…

What if that model is no longer available?

[saagarjha]

They’re typically not, since they typically rely on operators that aren’t (e.g. atomics).