[igmor]

Can you share any data on how big of a cluster is running Ray jobs?

[thedood]

From the blog post, the largest individual Ray cluster that was observed running a production compaction job in Q1 had 26,846 vCPUs and ~210TiB of RAM. This is roughly equivalent to a Ray cluster composed of 839 r5.8xlarge EC2 nodes (w/ 32 vCPUs and 256GiB RAM per node).

[layoric]

For those interested, this would be at a cost of:

- ~$1691/hour on demand

- ~$1065/hour reserved

- ~$521/hour spot

Not including any related data transfer costs.

[LarsDu88]

Wow that is not NEARLY as expensive as I would have imagined considering the scale of the data involved.

[artemisart]

That's also $41k / 26k / 13k per day or $1.2M / 767k / 375k per month!

[LarsDu88]

I mean, for all of Amazon's business intelligence, running on servers operated by Amazon... tis a mere pittance.