[dkobia]

We'll continue to see diminishing returns as time goes. The low hanging data sources have all been consumed and now everyone is battling for scraps of what's left. There's still a lot of optimization that can be done as illustrated by GPT-4o.

Basically the same trap as CPU's in the 90's early 2000's where the naming convention had to change to reflect the fact that speeds can't continue to double every 2 years.