This argument would be somewhat more compelling in a world where little bits of silicon were not on the order of quadrillions of times faster than we are at arithmetic, whereas those bits of silicon struggle to do at all things we casually do every waking second.
The calculation is theoretically unimportant. Practically, it is of great importance.
That's kind of a philosophical question no? Is being able to model an analog behavior accurately the same thing as the analog behavior itself? While we know from math there's an equivalence / bounded error rate, it certainly seems like emulation in the digital domain is far more power intensive which would indicate that it's not the thing itself. A clearer example is photon collisions. Simulating that behavior on a computer is not the same thing as colliding the photons. Could be wrong though.
Does it matter if the simulations of photons is on an abacus or using a GPU? I think that's the question. Neither of those are "reality", just a simulation.
>>>> Maybe ML uses some weird shortcut, but how do we know the human brain doesn't use the same shortcut? If it's possible to use some simple hack to do something, why didn't we evolve to work that way?
>>> Brains are radically different from GPUs.
>> The same calculations can be performed by an abacus. What is doing the calculation is irrelevant. The question is what the calculation is
> Does it matter if the simulations of photons is on an abacus or using a GPU? I think that's the question. Neither of those are "reality", just a simulation.
I think so, yes, specifically with respect to the question of "how do we know the human brain doesn't use the same shortcut?". Simulations likely use very different shortcuts because they're optimizing for the structural design of a man-made machine that exists today and uses numerical and CS tricks to cheapen the computation cost while maintaining error rates on training data. The brain uses physical shortcuts to minimize energy expenditure, for survival of the host, and resiliency of the species (i.e. OK if flaws exist sometimes as long as the species survival is improved long-term). So not only is ML a fun-house mirror image of a brain (our model is extremely imperfect today), the optimization process is totally alien to how the brain figured out all its shortcuts.
I’d just like to point out that if neurons do or don’t fire like logic gates that it basically doesn’t matter at all, not for this argument about Stable Diffusion or even in a deeper philosophical sense. It’s a silly question much like asking if a submarine can swim is a silly question.
The irony here being we're a few layers deep in a thread started as a critique on this kind of pointless anthropomorphism.
The calculation is theoretically unimportant. Practically, it is of great importance.