Hacker News new | ask | show | jobs
by vtuulos 988 days ago
Metaflow integrates with AWS Batch which many folks use for serious HPC. Internode scheduling happens through the multinode scheduling supported by AWS Batch. networking via EFA etc.

We'll blog more about this soon but you can certainly give it a try today! https://github.com/outerbounds/metaflow-ray