Hacker News new | ask | show | jobs
by bilekas 114 days ago
Why would it need to be a container?
2 comments
riddley 114 days ago
My ollama and GPU are in k8s.
link
amelius 114 days ago
Are you asking why people run things in a container?
link
bilekas 113 days ago
No, I'm asking why a website that someone could fill in a few fields and result in the optimized llm for you would need to run in a container? It's a webform.
link