It’s a fair point, but I’d argue “AI” is the whole stack, not just model weights. And AI is absolutely improving the whole stack in ways that make it smarter (from a consumer’s perspective).
True, but that is clearly not where the biggest potential gains lie. The number of different topologies we've tried for ANNs is miniscule compared to the number of biological neural networks evolution has tried. The latter are also far more intricately organized.
Honestly, when it comes to fundamental ANN topology improvement we've only just gotten started.
Honestly, when it comes to fundamental ANN topology improvement we've only just gotten started.