Hacker News new | ask | show | jobs
by boznz 3 days ago
The relays sound also like a nice source of monitoring for whoever controls them.
1 comments

Its so much stuff going through them, how would they monitor it all?
AI is big in GPU terms but in raw bytes the whole token economy is laughably tractable.

Case in point: OpenRouter is serving 60T tokens a week, but this is all human text and code (and cache hits!), which is almost certainly compressible enough that you could fit the whole week’s usage on a single hard drive.