[noosphr]

Do you know what the most cost effective hardware for general internet stuff is currently? I do ML and have to deal with removing tens of kilowatts from a small closet when it comes to on prem stuff - mainly for compliance reasons - and I have no idea what good, cheap low power hardware for web, sql and similar servers is.

[reactordev]

For general internet stuff, a Mac mini or any SFF pc will be just fine. For ML, you’ll need at least a dozen or more thousand for GPU’s if you run your own inference. If you use a 3rd party, like OpenAI, it’s just an API call and you can do that on your SFF mini or pi.

Web hosts can start at $10 (or free + internet) and GPU hosts can start at $4,000 USD.

At peak, a “cluster node” could be $10,000 and a GPU node could be $80,000.

The question you have to ask yourself is: what are your requirements.