[Cantinflas]

Why bother running models locally? Privacy, for once, or censorship resistance.

[seasonman]

Also customizability. Sure, you can fine-tune the cloud hosted models (to a certain degree of freedom), but it will probably be expensive, inefficient, difficult and unmaintainable.

[hanniabu]

And offline access