[uoaei]

They don't cache model state to disk. I am proposing they do.

[jeremyjh]

I’m proposing that you should educate yourself on the subject of LLM KV context caching.