[ynniv]

I'm pretty frugal, but my first thought is to get two to run 405B models. Building out 128GB of VRAM isn't easy, and will likely cost twice this.

[rsanek]

You can get a M4 Max MBP with 128GB for $1k less than two of these single-use devices.

[ynniv]

These are 128GB each. Also, Nvidias inference speed is much higher than Apple's.

I do appreciate that my MBP can run models though!

[ganoushoreilly]

I read the Nvidia units are 250 Tflops vs the M4 Pro 27 Tflops. If they perform as advertised i'm in for two.

[lolinder]

Don't these devices provide 128GB each? So you'd need to price in two Macs to be a fair comparison to two Digits.

[layer8]

But then you have to use macOS.