|
|
|
|
|
|
by bravesoul2
375 days ago
|
|
|
Yes LLMs are a funny workload. They require high amounts if processing but are very bursty. Therefore using your own bare metal is a low of expensive redundancy. For the cloud provider they can utilise the GPU to make it pay. They can also subsidise it with VC money :) |
|
|