|
|
|
|
|
|
by brucethemoose2
1023 days ago
|
|
|
Azure and such get such massive scaling cost benefits from scaling that HF's own GPUs would probably be more expensive anyway, even if they go AMD/Intel. It does seem like they should run their own storage nodes, with the sheer quantity of models they host... |
|
|
Typically, small companies get rebates on NVIDIA GPUs, but big established ones do not. So I would expect a startup with 100 GPUs to pay less per GPU than Azure.