Hacker News new | ask | show | jobs
by maxlamb 889 days ago
What are you using to run the Mixtral inference?
1 comments

Using Anyscale Endpoints, cheap and seems stable: https://www.anyscale.com/endpoints