[enum]

I’m not complaining. The clusters are great. The non-Slurm H100s are great. The Spark is more fun.

[latchkey]

What makes it more fun?

[enum]

I think that personal computing is more fun than time-shared computing. :)

It's remarkable what can now be done on a whisper-quiet little box. I hope the Strix Halo's will be just as much fun, and they should be, so long as Flash Attention works.

[latchkey]

Haven't tried to compile it for SH, but did compile it for MI355x and it worked. LONG compile time though ninja sure helped.

Fair, thanks for the answer.

The bane of my existence...

  salloc: Granted job allocation 1978
  salloc: Waiting for resource configuration

[moondev]

You can't attach a monitor to a h100, it has no video out.

Even ignoring GPU details spark is an awesome little quiet powerhouse arm64 workstation that is 100% Linux first

[latchkey]

At least on our offerings (MI300x), we offer console and even iDrac bios access (bare metal) and it is all running Ubuntu.

[moondev]

Sure what I mean is a physical monitor is more fun than a virtual console.

Curious though how you offer idrac to customer, do you have another OOB BMC for the idrac? Or is this internal engineering context

[latchkey]

I really don't understand the difference. Either way, it is just a window into a computer. ¯\_(ツ)_/¯

We rent bare metal on-demand and our whole business is to be able to offer compute that you probably wouldn't be able to host in your house $, as if you own it yourself.

So, we made it so that users can get access into the BMC and modify the box however they want. When they are done, we've automated the reset as well. Fully self-service.

$ These boxes are very expensive, weigh 350lbs, sound like a jet engine and consume ~10kW.

[moondev]

Can we agree that 10 minute boot time is not fun?