Hacker News new | ask | show | jobs
Ask HN: Options to Deploy LLMs?
1 points by johhns4 662 days ago
To deploy fine-tuned LLMs there are these options yes?

1. HuggingFace 2. Runpod 3. Bedrock 4. FireworksAI 5. TogetherAI 6. Replicate 7. Modal

Any other that I'm missing? What do you prefer and for what use, i.e. fine-tuned vs just inference as is.