[mpalmer]

This doesn't refute the (unmade) argument that inference is cheaper than training. Inference is cheaper than training, regardless of how much of each is taking place.

Not only that, both keep getting less expensive in various ways. small models, though still not cheap to train, are making inference vanishingly cheap.