Obviously you need new training rounds over time. Knowledge is not static. New things that are created would need to be part of later models.
How do you account for that? Do you account for some sort of model depreciation?
A lot of things are very nebulous in those leaked numbers.
How is "cost of revenue" considered? If Microsoft, Oracle and such provides computing at a loss to Open AI, that is clearly not sustainable, and it is a way to pretend the numbers are better than they actually are prior to an IPO. This might even be a source of pressure for an IPO. As losses accumulate in the ecosystem, they need to dump it into the public so they can bring the numbers to reality.
Also, I am not sure if they own any compute (for example, the Stargate datacenters). If they do, do they lump the costs of building those data centers all in "R&D"? That would be one hell of a way to pretend that inference is cheaper, good luck having inference without those datacenters.
The more I look at this, the more it looks like "OpenAI is profitable when you pretend they have no costs".
Obviously you need new training rounds over time. Knowledge is not static. New things that are created would need to be part of later models.
How do you account for that? Do you account for some sort of model depreciation?
A lot of things are very nebulous in those leaked numbers.
How is "cost of revenue" considered? If Microsoft, Oracle and such provides computing at a loss to Open AI, that is clearly not sustainable, and it is a way to pretend the numbers are better than they actually are prior to an IPO. This might even be a source of pressure for an IPO. As losses accumulate in the ecosystem, they need to dump it into the public so they can bring the numbers to reality.
Also, I am not sure if they own any compute (for example, the Stargate datacenters). If they do, do they lump the costs of building those data centers all in "R&D"? That would be one hell of a way to pretend that inference is cheaper, good luck having inference without those datacenters.
The more I look at this, the more it looks like "OpenAI is profitable when you pretend they have no costs".