Hacker News new | ask | show | jobs
by mcbuilder 554 days ago
I always plug openrouter.ai for making cross-model comparisons. It's my general goto for random stuff. (I am not affiliated, just a user)
1 comments

I love the idea of openrouter. I hadn't realized until recently though that you don't necessarily know what quantization a certain provider is running. And of course context size can vary widely from provider to provider for the same model. This blog post had great food for thought https://aider.chat/2024/11/21/quantization.html
To expand a little, some providers may apply more aggressive optimization in periods of high load.