|
|
|
|
|
by hyperbovine
314 days ago
|
|
> Sparse models for example show a lot of promise and more closely track real biological systems. I think sparsity is a consequence of some other fundamental properties of brain function that we've yet to understand. Just sparsifying the models we've got is not going to lead anywhere, IMO. (For example it's estimated that current AI models are already within 1%-10% of a human brain in terms of "number of parameters" (https://www.beren.io/2022-08-06-The-scale-of-the-brain-vs-ma...).) |
|