Hacker News new | ask | show | jobs
by oidar 516 days ago
This is very good at this right now too: https://melty.sh/chorus
2 comments

You should also note that Chorus allows you to bring your own API keys and interact with local models. Both features I very much appreciate!
One tradeoff of bringing your own API keys is that as you add more model providers, you get more billing accounts to deal with. Chorus also doesn't have an incentive to efficiently use your tokens. We save 67% on Anthropic token costs using Claude Caching. We also use cheaper "task models" for conversation titles, tagging, and parts of the RAG pipeline which all drastically cuts token costs.

For local models I highly recommend https://github.com/crizCraig/open-webui

They do the side by side thing that Chorus does and you can serve it to anywhere including your phone.

This is like showing the top 3 results from Google search side by side. I'm not sure that's what I want, to be honest.
You haven't dug in far enough. It's not for chatting with LLMs, it's for comparing LLMs.
No, more like showing the top 3 results from Google, Bing, and Kagi at the same time next to each other, if anything.