Hacker News new | ask | show | jobs
by imtringued 534 days ago
The neurons are always learning whereas the matrices don't change.
1 comments

I mean, the matrices obviously change during training. I take it your point is that LLMs are trained once and then frozen, whereas humans continuously learn and adapt to their environment. I agree that this is a critical distinction. But it has nothing to do with “meaningful internal structure.”