[threeseed]

Very unusual specs on paper.

- Air cooling 6x4090 and a 32 core CPU for sustained peak workloads.

- 3200W total power when a single 4090 can draw close to 600W.

Maybe they are targeting startups who aren't interested in overclocking.

[arder]

I think the plan with this all along was George went off and built exactly what he thinks he needs for his specific work and then just makes it available. So is the wildly underpowered CPU bad? I don't know, I don't know his use case.

It also seems just weird from a business point of view. He's not going to sell many, he's not going to offer support, he's not at a scale where vendors are going to offer much particular support, and despite being absolutely tiny in scale he's still offering two totally different SKUs.

[jagrsw]

This thing could run off a single US outlet (1600W) with some throttling, if I'm not mistaken?

Shame it wasn't designed for EU sockets. 230V*16A = 3700W, or double that on separate breakers!

[apexalpha]

3200W seems perfect for a EU socket.

Seperate breakers aren't really a thing here, at least in my country, usually if you need more power you draw 400V

[Hellolearning]

No it doesn't. A standard EU Socket is not certified for 24/7 3.2kW.

You should max. pull 2.7kW.

For everything else you need a blue eu socket or camper socket.

I learned this due to my EV which is able to be charged through a normal socket but it regulates it down due to this on purpose and has a temperature sensor build in as well.

[xxpor]

US circuits are the same way. "Sustained use" (over 3 hours IIRC) has to be de-rated to 80% of max. So an EV can draw 40A on a 50A circuit.

[andersa]

So if it doesn't use 3.2kW continuously, but varies significantly based on what it's doing (perhaps even idle sometimes) then it's fine?

[Hellolearning]

Yes. But you shouldn't risk it if you don't know. A ml job can run for hours or days

[jagrsw]

Is it per spec, or from experience?

[Hellolearning]

from spec. full load only needs to be supported for up to an hour

[bguebert]

On their site they say it can run at 220V 15A if you got that.

https://docs.tinygrad.org/tinybox/

[jagrsw]

Just being nitpicky - I'm from the EU, but I think in the US, you can get either:

  240V: Split-phase, this gives you 120V between each leg and neutral, and 240V across the two legs.
  208V: The interphase in a 3-phase system.

Might be still within tolerance of 220V :)

HTH, ducking out :)

[georgehotz]

Specs on website updated, anywhere from 100-240V is fine

[WithinReason]

A 4090 draws 450W unless you unlock the power limit

[Timshel]

Transient might be an issue. GN discuss transients of ~30/40% over the nominal 450w (https://www.youtube.com/watch?v=j9vC9NBL8zo&t=616s).

And with a distributed training you can end-up with "synchronized" transients over all cards :(.

[jagrsw]

I hold an electrical certification in the EU, though I'm not currently practicing.

A quick point: transient surges are usually fine. Both cables and circuit breakers are designed to fail (trip or burn out) under sustained overloads. For example, a 16A Class C circuit breaker might take around an hour to trip with a constant 17A load, but a ~80A load would trip it ~instantly.

PS: Of course, everything is a matter of integration over time (heat dissipation in cables mostly).

[zten]

The workstation equivalent, the RTX 6000 Ada, defaults to 300W. You can get most of the performance of a 4090 by capping the power.