[betaby]

Our company can buy NVIDIA gear. Google TPU, well, is google's property I have no control over. This site is overrepresented by clod folks. In reality ~90% of the workloads are NOT cloud based. Unless one can buy Google/Amazon/Meta T/N/AI/PUs that unique optimizations are irrelevant for the most of the workloads.

[debbiedowner]

Why 90%? Why don't you go on the cloud for training at least if it's not healthcare data?

Is it because you don't need to buy many gpus to do your workload?

[betaby]

Reasons why people don't go on the cloud were outlined many times, i.e. https://world.hey.com/dhh/we-have-left-the-cloud-251760fb was discussed on HN many times.

I could have written almost the same reasons for GPU workloads.