[casey2]

I think people don't understand that the value of the data generated by chats/agents is conservatively worth $200B a year. This is the so-called data-flywheel. Google is going to keep spending until they hit the break even point.

More than a quadrillion high quality tokens per year. Pretty soon they will have an automated team of scientists doing basic and advanced research in every field. All those tokens will be fed back and make the model much more inference efficient.