[johnc1231]

I suspect doing that will break down in the case of large Spark shuffles though?

[khc]

It's the default but you can change it. Most people will appreciate the cost savings