[dwrodri]

The idea of setting up my own cluster seems really cool, but it always seems that I'm paying more money for less compute vs. just buying a single more powerful computer. I suppose this is worth it for people who'd like to physically own a cluster where they can test their cluster code with a real network layer before deploying that code to a data center?

The MSRP for Nvidia's Jetson Xavier NX 16GB module is USD500. So 4 Xaviers + board is USD2200 for a combined 64GB of LPDDR4 memory and 84TOPs of Compute.

On the other hand, I can buy an Nvidia RTX3080 with 10GB of memory on the card and 238 INT8 TOPS for ~USD1000, 64GB of DDR4 for USD250 and the last USD1000 on whatever other parts I need to get something working.

The only counterexample I can think of is that the cluster could potentially be easier to upgrade/purchase in pieces, which would be more ideal if you're broke and would like to get started on a budget. And of course, there are probably some use cases where the topology of the Jetson Cluster leverages its hardware more effectively than the single GPU.

Can someone help this make sense for me?

[zimpenfish]

It's handy for me (with a Turing Pi 1) because it's one power (in a flat with distressingly few power outlets) and one ethernet for up to 8 computers. Like a mini-rack, if you will.

> On the other hand, I can buy an Nvidia RTX3080

Good luck with that in the UK. I know someone who ordered on launch date, still hasn't got one, and has been told there's no more coming from that brand...

[edit: to clarify that I have a TPi 1]

[dwrodri]

Very true on the note of supply. My only counterpoint is that all of Nvidia's products have been supply-constrained, their Jetson line included. The Jetson Xavier NX has a 10 week lead time on Mouser. So it seems that if you're interested in setting up a compute-heavy cluster with Nvidia products, you're just SOL.

Honestly, I've recently gotten a surprise financial windfall, and I could see myself lining up to buy the TPi 2 along with with some 16GB Jetson Orin SoMs if the TPi 2 supports them.

[alimov]

Yeah it’s been tough. I went to a bestbuy in the states and they happened to have several 3080 and 3080ti available… while in the store I checked to see if they listed the inventory online and they did not…