[awesomeMilou]

Because GPU-Servers that can run a typical LLM are less than 5k, which includes installation. Really, running an LLM seems to be no more complicated than running a NAS from a system administrators perspective.

Emphasis on running, not training.

[MichaelZuo]

5k can't even get you 80 GB of VRAM on a GPU. How is that possible?