[aiappreciator]

"the training cost is going to be dominated by the inference cost."

That's only true for general-mass-consumer models.

Companies may want to fine-tune/train their own models, which don't have that many users for their narrow use cases (possibly only internal staff), will find that training cost is a substantial chunk of the TCO