Well I'd probably consider myself a materialist but I'm not sure I'd agree. The evidence to me seems that it can really only come from two places: additional compute or new breakthroughs in AI learning. Compute's coming, certainly, but that only has the potential to improve things if it's added in conjunction with a commensurate AI breakthrough. I think the trend in improvement for transformer could be logistic, not exponential, like a lot of the snake-oil salesman like to state. And while there's plenty of evidence for compute there isn't much for the AI breakthrough that leads to an exponential jump, and if it does exist it's a trade secret, so until we know we don't know.