Hacker News new | ask | show | jobs
by pploug 357 days ago
Well, more wondering how I go from having local models into a production app with the model available - I guess swap it with a cloud offering?
1 comments

You can run the same model in production, using Docker Model Runner in Docker CE. This is assuming, the model works for your production use case :)