|
This, this right here is the EXACT situation that causes all the bioinformatics guys to be EXTREMELY NERVOUS using biological analogies like neurons for machine learning topics. They are NOT actually analogous except in the shallowest ways. First off, there's substantial evidence to suggest that in a biological systems, an activation profile of the neurological system is more analogous to what a Neural Network in machine Learning considers a 'neuron'- that means that when you consider the spider, you're not looking at 600K nodes, you're looking at 600,000 FACTORIAL. As in 600K!, or approx. 2x10^3,200,000. Second, even THAT number may be substantially too small, because the STRENGTH, as represented by the number of connections a given node in a biological Neural net has to another node, can ALSO variably affect the performance/recall/whatever of the organism. I don't recall what the higheat known number of connections between two nodes is in humans, let alone spiders, but it is not only 2 or 3, it can be many more. Portia and other insects are operating on an entirely different level, with different hardware, and a different operating system, than your Neural Network ENTIRELY - trying to compare the nodes-to-performance ratio of the spider vs. the DNN is not even wrong, it's like the Twilight Zone of every computer competent neuroscientist on this planet. Utterly and completely meaningless, except maybe in an inspirational sense, to flagellate your statisticians into feeling so inferior that they magically squeeze greater performance out of their networks, not because they cleverly utilized the fundamental differences between biological and silicon computer systems, but rather because they feel so bad about the comparison. I apologize for my snooty tone- in college I argued with a professor about this, with me asserting that clearly, no one would every REALLY equate biological neurons with machine learning neurons one-to-one, and yet here you are, clearly he was right and I have lost our bet, I shall have to go back and eat a hat. ;) |