[andersa]

Hmm. Seems like a bad deal.

This is a monthly reservation for a single 6000 Ada for $940. You can get the same on RunPod for $670.

And to actually train stuff you'd likely want nodes with more of them, like 8, or just different GPUs all together (like A100/H100/etc).

[kirab]

Hetzner customer here. It’s a little hard to understand in the UX, but the price shown is the monthly max price.

It is actually paid by the hour.

The price per hour for this server is € 1.5980

more info: https://docs.hetzner.com/general/others/new-billing-model/

[reitzensteinm]

But the setup fee is €86.90. Is that not paid each time you provision the server?

[dindresto]

That's incorrect, dedicated Hetzner servers do not have hourly pricing. That only applies to Hetzner Cloud.

[lutoma]

No, they switched to per-hour billing for their dedicated servers a while ago. I also tested this last week when I cancelled a dedicated server we had with them and they did indeed only charge for part of the month.

[nevi-me]

There's a difference in being charged a partial amount for the month vs an hourly amount for something you need for just 2 hours.

I have a dedicated machine with Hetzner, and AFAIK they charge me the full amount regardless of whether it's on or off. If I cancel on day 3 of the month, it makes sense to be charged for only those days' hours. However that's different to "turn it on for 6 hours" kind of hourly pricing.

[reitzensteinm]

That's incorrect. Dedicated servers do now offer hourly pricing. See this page which lists the hourly pricing for the new GEX130 server:

https://www.hetzner.com/dedicated-rootserver/matrix-gpu/

But, as far as I know (hence the sibling question), you still need to pay the setup fee each time you launch.

[dindresto]

Actually rechecking the terms of the GPU server, it states:

> Cancellation period: 30 days to the end of the month

To me that indicates it's not possible to order the server for only a few hours.

[reitzensteinm]

That term appears on all servers, but seems to be in conflict with their billing FAQ: https://docs.hetzner.com/general/others/new-billing-model/

Either way... it's a mess. They added hourly billing for dedicated servers six months ago, there's not much excuse for still having contradictory information hanging around.

[Hetzner_OL]

Yes, the GEX130 has a *one-time* setup fee. And yes, it is possible to cancel it on an hourly basis in most situations. For example, if you only had it for 3 days of a billing period, you would pay the hourly rate. We are currently in the process of updating our billing systems. There are a few situations where the 30 day to the end of the month policy still applies. For most situations the current cancellation process is more generous and flexible for the customer. And for the rest, it has stayed the same. If customers want to stop paying for a server, they need to cancel it. We have a number of products that do not include setup fees, including our Server Auction dedicated servers and our cloud servers.

[lnxg33k1]

I guess now with the pricing confusion they've fully embraced the cloud industry

[kirab]

You’re right, the billing is hourly (until you reach the monthly cap) but you also have this cancellation period. That’s weird?

[dindresto]

Thanks for the link, seems like a major flaw to combine hourly pricing with a setup fee. :')

[nevi-me]

I'd read that hourly fee more as a comparative.

[JosephRedfern]

That's not a like-for-like comparison, though. ~2TB local NVMe storage included here, 10 (70%) more CPU cores, and more than twice the RAM.

[dist-epoch]

The non-GPU part is like $70 a month (also at Hetzner).

[indigodaddy]

How long I wonder before these sorts of things will be affordable to the more everyday person say sub-$100?

[andersa]

Not before the bubble pops.

[jsheard]

Even when it does, GPUs with more VRAM than a flagship gaming model have always and will always come at a massive price premium. That ceiling is currently 24GB, if you need more than that it's going to cost you.

[rafaelmn]

I don't see why. AMD could buy a lot of free community work just by putting out a 32 GB version of their next gen flagship at around 1k. Not chasing the margin for a generation would buy them a decent amount of community support - they need it if they want to compete with Nvidia at any point.

Ahh I just saw OP was saying sub 100$ - yeah that's never going to happen.

[InvaderFizz]

VRAM is such a small portion of the BOM that they could double it, keep the same margins, and the MSRP would only increase by like $300.

The problem isn't margin on the consumer cards, the problem is competing with their even higher margin workstation cards.

[rafaelmn]

Thing is AMD can't have Nvidia margins because nobody supports them - take a hit for a generation on pro sales - get market/mind share and then you have a chance to play the same game.

[lugao]

> next gen flagship at around 1k

Have you seen GPU prices lately (last 5 years)? A RTX 4080 super with merely 16 GB of VRAM is at least 1k, there's no way a 32 GB next gen flagship would be released at this price range.

[rafaelmn]

I don't see Nvidia canibalizing their server cash cow, but AMD has much less to lose and more to gain.

[nusl]

Well, you get the entire server and not just a GPU, so you can do what you want with it.