[teaearlgraycold]

Ah, well today I learned about ECS. I guess we’ll migrate to that once I need to add complexity to our EKS setup.

I’m new to this stuff, so it’s hard to dig through all of the possible different solutions.

I looked into Ray a bit but it seemed a little too complicated vs. just running a CUDA accelerated docker container. Most of the streamlined solutions in this space are not made for full stack web developers deploying a service that happens to need a GPU. They’re for ML devs who are trying to own the production side of their part of the product.