Hacker News new | ask | show | jobs
by jychang 411 days ago
> Optional local AI tagging

https://docs.linkwarden.app/self-hosting/ai-worker

I took a look at this... and you use the Ollama API behind the scenes?? Why not use an OpenAI compatible endpoint like the rest of the industry?

Locking it to Ollama is stupid. Ollama is just a wrapper for llama.cpp anyways. Literally everyone else running LLMs locally- llama.cpp, vllm (which is what the inference providers use, also I know Deepseek API servers use this behind the scenes), LM Studio (for the causal people), etc all use an OpenAI compatible api endpoint. Not to mention OpenAI, Google, Anthropic, Deepseek, Openrouter, etc all mainly use (or at least fully supports, in the case of Google) an OpenAI compatible endpoint.
2 comments
CaptainFever 411 days ago
You could contribute an option!
link
dewey 411 days ago
> Locking it to Ollama is stupid.

If you don’t like this free and open source software that was shared it’s luckily possible to change it yourself…or if it’s not supporting your favorite option you can also just ignore it. No need to call someone’s work or choices stupid.

link
jychang 411 days ago
Strong disagree. Just because something is free and open source does not make it good. Call a spade a spade.

Ollama is a piece of shit software that basically stole the work of llama.cpp, locks down their GGUFs files so it cannot be used by other software on your machine, misleads users by hiding information (like what quant you are using, who produced the GGUF, etc), created their own API endpoint to lock in users instead of using a standard OpenAI compatible API, and more problems.

It's like they looked at all the bad walled garden things Apple does and took it as a todo list.

link
dewey 411 days ago
That’s not the point, you didn’t say “Ollama is stupid” you said “Locking it to Ollama is stupid”.

Not every person is aware of all faults or politics of all their dependencies.

link
jychang 410 days ago
That's an absolutely terrible defense. Ignorance is not an excuse, try telling that to a police officer.

And plus, certain people are held to a higher standard. It's not like I'm expecting a random person on the street to know about Ollama, but someone building AI software is expected to research what they are using and do their due diligence. To plead ignorance is to assert incompetence at best and negligence at worst.

link