[zsyllepsis]

Maybe a charitable reading of the parent comment, but my interpretation of it was that while the _models_ are stateless, modern deployments of these models for inference rely on state.

For example, tiered pricing for cached context relies on state, even if the models don’t.

[zahlman]

For that matter, the agent harness accumulating "chat history" is state.