Y
Hacker News
new
|
ask
|
show
|
jobs
by
zipy124
294 days ago
I think you mis-read. Thats 22k tokens per second
per node
, so per 8 h100's. With 12 nodes they get 264k tokens per second, or 950 million an hour. This get's you to roughly $0.2021 per million at $2 an hour.