Hacker News new | ask | show | jobs
by thfuran 620 days ago
It's been something like half a billion years since the first brain.
1 comments

That was a much smaller model, couldn't do much more than crawl around and run away.
It was still used as part of pretraining the current model.
Nonsense, the current model is a new architectural approach.

It was all explained in that recent paper, "Attention is all your meat"