[Aurornis]

They’re widely available to rent.

Unless you’re running it 24/7 for multiple years, it’s not going to be cost effective to buy the GPU instead of renting a hosted one.

For personal use you wouldn’t get a recent generation data center card anyway. You’d get something like a Mac Studio or Strix Halo and deal with the slower speed.

[varispeed]

I rented H100 for training a couple of times and I found that they couldn't do training at all. Same code worked fine on Mac M1 or RTX 5080, but on H100 I was getting completely different results.

So I wonder what I could be doing wrong. In the end I just use RTX 5080 as my models fit neatly in the available RAM.

* by not working at all, I mean the scripts worked, but results were wrong. As if H100 couldn't do maths properly.