|
|
|
|
Show HN: Token Thermodynamics
(mybinder.org)
|
|
4 points
by gpavanb
49 days ago
|
|
|
We often focus on tokens/second and dollars/token, but rarely on the environmental cost per token. This work presents a step-by-step analysis of the energy and water footprint of LLM inference. |
|
|