Hacker News new | ask | show | jobs
by dawnerd 790 days ago
Tried a few queries and was surprised how fast it responded vs how slow chatgpt can be. Responses seemed just as good too.
2 comments

Inference speed is not a great metric given the horizontal scalability of LLMs.
Because no one is using it