Hacker News new | ask | show | jobs
by emberfiend 1192 days ago
This feels somewhat close to how human minds work, to me, maybe? I know my diction gets super stilted, I compose complex predicates, and I use longer words with more adjectives when I'm talking about technical subjects. When I'm discussing music, memey news, or making simple jokes I get much more fluent, casual, and I use simpler constructions. When I'm discussing a competitive game I'm likely to be a bit snarkier, because I'm competitive and that part of my personality is attached to the domain and the relevant language. And so on.
1 comments

I think it resembles some part of how human minds work.

But it's missing explicit symbolic representation, and that's a serious limitation.

What's more interesting is that a lot of the behavior of "human minds working" is explicitly modeled into language. Because GPT implicitly models language, it can "exhibit" patterns that are very close to those behaviors.

Unfortunately, being an implicit model limits GPT to the patterns that are already constructed in the text. GPT can't invent new patterns or even make arbitrary subjective choices about how to apply the patterns it has.