[d33]

They still can't beat the laws of physics. It's just the kind of density that doesn't seem feasible to put in a smartphone.

[wewtyflakes]

Human brains seem to be of the same order of magnitude in terms of size, and seem more nuanced and capable than GPT4.

[kortex]

The human brain is also three-dimensional, heavily interconnected, and has built-in thermal management at every scale. Chips are much faster, but still operate on the essentially linear memory cells, and this limits how many matmuls you can do per second. If we can figure out true connectivity without doing tons of matmuls, then we should be able to massively cut computational demands of models.

[fbhabbed]

It's not apples to apples comparison. There's a multitude of tasks that human brains are very bad at.

GPT excellence is in raw knowledge and answering machine. You won't find a single human brain that can hold the same amount of knowledge