|
|
|
|
|
by HarHarVeryFunny
320 days ago
|
|
Sure, and it wouldn't be surprising to see different pricing for realtime AI API usage vs slower (overnight, etc) response times (to fill up the seats and keep the hardware occupied). It remains to be seen how the dynamics of this works out though - function of cost of increasing capacity vs customer demand at various price points and service levels. LLM pricing seems to still very much be up in the air though - models getting more efficient, serving hardware getting more efficient, use cases evolving, and not all providers operating with same business model (e.g. Meta, maybe China). |
|