Hacker News new | ask | show | jobs
by amelius 116 days ago
It can become complicated when you run it inside a container.
1 comments
bilekas 116 days ago
Why would it need to be a container?
link
riddley 116 days ago
My ollama and GPU are in k8s.
link
amelius 116 days ago
Are you asking why people run things in a container?
link
bilekas 116 days ago
No, I'm asking why a website that someone could fill in a few fields and result in the optimized llm for you would need to run in a container? It's a webform.
link