Hacker News new | ask | show | jobs
by esafak 509 days ago
Is this useful? Can someone help me see the value add here?
4 comments

It was mentioned in the other thread on the front page [1]

[1] https://news.ycombinator.com/item?id=42886680

Well, if you aren’t that great with Docker but you want to try out a variety of LLMs under Docker, how much would this help you? How much trouble is it to enable an LLM to reach outside of a container to make use of your GPU? How much does this tool help with that?
ramalama can just pull (almost) any arbitrary model off huggingface and run it ... you're not limited to just what ollama has repackaged into their non-standard format