Also, regarding preemption, you could just checkpoint your batch jobs. I.e. assume that there are failures, and be ready for them.

I also wonder how many preemptions actually occur in practice. I.e. if not many, you can just treat them as failure and restart your nodes.

The strength of kubernetes is in distribution and ecosystem , which would be very hard to match.