Hacker News new | ask | show | jobs
by krzyk 5 days ago
Ollama is not a good choice - https://sleepingrobots.com/dreams/stop-using-ollama/

As for oprncode, doesn't the system prompt eat too much of the context? Local models are really constraint in regards contex, and opencode AFAIR uses a 10k of it or some thing close.

1 comments

Ollama seems fine to me, technically. it works. why wouldn't someone use it? Because someone else doesn't like it? if it cost money, I'd pay more attention to the people behind it, but I don't, so I don't.

I wish people would stop wasting their outrage budget on things like this and pay more attention to politics.

Focusing outrage on politics is pointless.

Technical people are rather good at learning new things, and ollama situation is a good learning experience.

llama.cpp gets you more tokens/s even if you ignore ollama team bad behavior.

Political outrage is only pointless (in the cases when it is actually pointless), because not enough people get outraged.

Politicians count on your apathy so they can get away with their horseshit. You paying attention is kryptonite to crooked politicians.