Y
Hacker News
new
|
ask
|
show
|
jobs
3000 tokens/sec LLM playground
(
playground.kog.ai
)
6 points
by
rashkov
26 days ago
2 comments
rashkov
26 days ago
Actually getting to use this is different than just reading about it. Feels like a preview of the future.
Related discussion of their writeup:
https://news.ycombinator.com/item?id=48321076
link
phillipseamore
25 days ago
What am I missing? It can't even list countries in NATO correctly, chatjimmy.ai can do that and output 17000 tokens/sec on cheaper silicon.
link
rashkov
25 days ago
I don't think you're missing anything, the speed is the impressive thing but the model is limited. Perhaps Chatjimmy is more impressive in this respect. Most people haven't tried either
link
Related discussion of their writeup: https://news.ycombinator.com/item?id=48321076