Hacker News new | ask | show | jobs
by kkotak 32 days ago
Why is the insane speed of 13KTPS of this site is not more on the the top of the AI conversations?
4 comments
mike_hearn 31 days ago
Because there's been nothing to discuss since their announcement. Their API access immediately closed due to overwhelming demand and they didn't fab newer models than Llama3 yet.

Probably they will make bank selling to HFT for a while.

link
mlrtime 31 days ago
Because I just tested it and it took 3-4 clarifications before it actually gave a correct response vs gemini/google search. It's not great, but good.

I'd rather wait 3x as long.

link
Ey7NFZ3P0nzAe 32 days ago
It's pretty well known by now.
link
chromadon 32 days ago
I asked it for a block of C++ code and it hit 14,189 tok/s. I assume it cached someone else's session?
link
fcsp 32 days ago
No - it's custom silicon https://news.ycombinator.com/item?id=48693490
link