[pm90]

Not to mention there is all sorts of other limits that you can hit at scale just on the compute layer itself (eg max pids, file descriptors etc).

I don’t know if we can truly abstract away the underlying system. The best we can do is give a best effort approximation that works in most cases, but explicitly call out the limits when they are reached.

I suspect that this is just the bubbling up of the underlying physics limitation of having limited resources where compute is run.