Hacker News new | ask | show | jobs
by tomp 1178 days ago
I talk to people who want to set up infra to use cloud GPUs and many of them say "I want to use Modal".

Common reasons not to include (1) "I have soooo many AWS credits that I want to use" and (2) (our company's reason) "We have on-prem GPUs but sometimes need Cloud GPUs as well with the same interface".

Using e.g. Ray with AWS is very painful, took us a long time to iron out all the quirks.

1 comments

Yep AWS/GCP/Azure credits are a common reason. It's been discussed within the team, and we should work something out for that.