Hacker News new | ask | show | jobs
by Moissanite 1343 days ago
Depends on what "4 hours per day" really means. If you want an interactive endpoint, putting in the work to set up an ECS task you can start and stop feels like the best approach. If you have longer-running inference tasks and just want to pick up results asynchronously, Batch (which is a layer on top of ECS) seems like the way to go.

SageMaker might have an abstraction which is a closer fit for your particular use-case, but I'd be wary of potential cost excesses; running on raw EC2 and automating the lifetime somehow is inevitably going to be the cheapest route.

1 comments

The task takes about 1-4 minutes. In an ideal world, it can start immediately and then shutdown, but more realistically it will have to spin up or batch things up at a convenient point in time. Sagemaker seems more expensive that doing it via ECS.