[int_19h]

$5M once, upfront. But given the significantly increased throughput, how fast does that pay for itself?

[fzzzy]

You need computers for all of them and megawatts of power, power supplies, cooling, and power distribution.

[int_19h]

Naturally, but you need that for GPUs as well, no? What is the actual difference when running, when measured per token generated?

[gessha]

Depends on power usage. I’m curious how power hungry those are compared to server/workstation cards.