[barbacoa]

>sticker price is 7899.

It's not even worth it at that point.

You can get a used enterprise grade SXM baseboard with 4-8 V100/A100 GPUs off eBay at a similar price. That will even get you actual HMB ram and NVlink. Along with 10x the AI performance, assuming you don't care about your electricity bill of course.

[somewhatrandom9]

You can get a new M5 Max MacBook pro with 128 GB unified ram (targeted by Antirez for DwarfStar4) even after the Apple price increases, it's less than 7899 by at least $1000. And you probably won't pull more than 100 Watts.

[sspiff]

You are comparing US pricing with EU pricing. EU pricing includes 21% VAT and currency conversion "rounding up".

The cheapest 128GB Macbook Pro here costs €7.949,00.

No doubt a better value than the HP, and will depreciate a lot less quickly, but just as expensive. Unfortunately, not being able to run Linux is a breaking point for me.

[dehugger]

I have one of these. Got it a few weeks before the price increases. On the 14" version charging is limited to 96 watts, but the chip can pull north of that with adequate cooling, so the battery will literally drain while plugged in.

It isn't a problem for me, more amusing than anything else (I run in Low Power mode 90% of the time) but worth knowing for anyone thats thinking about pushing the hardware to its limit 24/7.

[wtallis]

> And you probably won't pull more than 100 Watts

I've played with ds4 on such a machine, and the battery drains when using only a 96W power brick. But you can put it in low power mode and the fans won't even turn on while it delivers something like a third of the performance.

[Keyframe]

ignoring the fact one would need a bit of a different setup (chassis, PSU) to run it, I casually looked and there's nothing below $25-50k euros for such a board decked out, depending on the config. TBH even that doesn't sound bad, but I wouldn't even know where to start how to run it.

[barbacoa]

This is from the USA site:

https://www.ebay.com/itm/157742745616

It's always a gamble buying used electric but per the description, fully decked out server with 256gb vram.

Though at 2U it is going to sound like a 747 taking off from your office.

[gessha]

So that’s where all the used V100s are going. I’ve been thinking about making a water cooled version of those because I don’t have a rack to put these servers on.

[blincoln]

That's surprisingly inexpensive for 256 GiB of VRAM, but how much power would it take to run it? Is it even feasible with residential circuits?

[sspiff]

Yeah it isn't worth it, but comparing a server with a laptop is also not a relevant comparison.

I didn't get a Strix Halo laptop because it was the best bang per buck, I got it because it was an awesome machine that could do a little bit of everything, fit in a backpack and only needed 140W.

But noone should buy one at 7899, obviously. It was a tough sell for me at the old 2800 pricing.

[skinfaxi]

Can you link because 8k is the price of two A100s so that would be a steal.

[barbacoa]

4x A100s with the baseboard for $9k (USD).

https://www.ebay.com/itm/336632412718

Buy one and let me use it when you're sleeping.

[nicman23]

how do you even connect these? i assuming expensively

[barbacoa]

The connection does not look standard so probably need to find some kind of OEM interposer card, which would allow you to connect some slimSAS cables that in turn connect to pcie adapter cards.

You'd need at least threadripper cpu/motherboard to handle that many pcie slots/lanes.

Not to mention that a baseboard like that is not going to work with a standard ATX power supply, so you'd have to provide your own power solution.

If that doesn't sound fun to you, you're probably better off buying Claude tokens.

[nicman23]

first off rude, secondly, the issue is the existence of a mcio to whatever mess that thing is. i assume it is sxm5 or something and you probably need a pci-e 6/5 switch in the middle