Hacker News new | ask | show | jobs
by swyx 1164 days ago
beautiful work as always jared!

one of the useful things from nat.dev was the tokens/second calculation, latency is impt as usual. would be nice to enable?

i'm excited to see what the upcoming products are. making things default sharable like this across all frameworks would be really nice.

1 comments

Thanks man! Good idea on token/s. Will add
Would be nice to know cost too!

tokmon is on showHN today too

https://news.ycombinator.com/item?id=35616871

I'm super excited in graphing this over time. Will be interesting to see how the providers develop over the coming months. FWIW we also need TTFB not just tokens per second. The first token is key for UX