Hacker News new | ask | show | jobs
by cwoolfe 169 days ago
What's the most cost-effective way to run open source models using cloud infrastructure? AWS? Digital Ocean? salad.com? Lambda.ai? Vast.ai? Use case is infrequent and small usage, but needs to be able to scale to match increasing demand.
2 comments

Modal is great for infrequent batches.
ssh admin.hotaisle.app