[infinite_spin]

while the how is different, the what has many parallels. E.g. both the brain and LLMs appear to learn distributions of representations, they both develop a hierarchy of those representations, both have early layers that process simple features, with later ones processing more abstract concepts, both predict missing information...

[root_axis]

The post I responded to stated that the commenter was just a next-word-sayer, but that's wrong. The similarities you draw aren't really relevant to my reply.

[infinite_spin]

no disrespect intended, however I think my response is relevant, because the broader topic here is whether LLMs and the human mind share similar functions. They both do in fact have a lot of overlapping features, and a fundamental one is predicting next-thing, be that a word, image, or otherwise.

[root_axis]

It's not relevant. However, if you want to talk about a broader point, that's ok.

> LLMs appear to learn distributions of representations, they both develop a hierarchy of those representations, both have early layers that process simple features, with later ones processing more abstract concepts, both predict missing information.

This type of superficial comparison isn't very meaningful, it's trivial to liken anything to a human biology in this manner.

A plane and a bird both use wings to produce lift, it doesn't then follow that a bird and a plane are meaningfully similar.

[infinite_spin]

> A plane and a bird both use wings to produce lift, it doesn't then follow that a bird and a plane are meaningfully similar.

The use of Bernoulli's principle to achieve lift is a fundamental and meaningfully similar function of both airplane and bird wings. That functional similarity is well known.

> This type of superficial comparison isn't very meaningful

The comparisons I provided are fundamental to both the human mind and LLMs.. that's pretty darn relevant.. and whether you find that trivial or not is a matter of opinion.