[phantompeace]

How do you know it's being served at wildly below cost? AFAIK API pricing across the board is actually higher than what inference would cost? Yes there are subscription plans that subsidise tokens but they exist primarily to hook people in, so as to encourage their workplace to adopt it, whereby they then have to pay for an enterprise plan with zero subsidies like the subscription plans have. Training is very expensive, but you only do that once.

I predict costs will fall.