[icelancer]

Self-racking lets you rack a bunch of gear you'd never find in VM/dedicated rentals, like consumer parts or older, still very good parts. Overclocking options are available as well if you DIY.

If you need single-threaded performance, colo is really the only way to go anyway.

We have two full racks and we're super happy with them.

[Melatonic]

Or under clocking and under volting for even better performance to price/power/longevity ratios

[sroussey]

For a single rack, you really don’t have too many choices for power. You make a choice to provision and pay, I never had anyone check how much of that I used and give me money back. Maybe things have changed though.

[icelancer]

No doubt. Especially for GPU inference at scale. We overclock/overvolt for training and tune way down for inference.