[redcalx]

> essentially curve fitting on steroids

Biology is essentially simple chemical reactions on steroids. I.e. you have assumed there is a qualitative distinction between biological brains and artificial neural nets that cannot be overcome by scaling up. However (A) AI models are many, varied and new variants are being explored all the time, and (B) there are systems where new new dynamics appear at larger scales, thus producing a qualitatively different system based on the same underlying rules, e.g. physics -> chemistry -> biology -> human brains -> social networks.