Hacker News new | ask | show | jobs
by 2Gkashmiri 1204 days ago
Is that good? Not good?
2 comments

A token is approximately 4 characters. So, four characters per 8 minutes is pretty slow. This comment would take 1224 minutes to generate, if I was an AI.
Usually you want tokens per second, not seconds per token. So it's a bad sign.