|
|
|
|
|
by emberfiend
1192 days ago
|
|
This feels somewhat close to how human minds work, to me, maybe? I know my diction gets super stilted, I compose complex predicates, and I use longer words with more adjectives when I'm talking about technical subjects. When I'm discussing music, memey news, or making simple jokes I get much more fluent, casual, and I use simpler constructions. When I'm discussing a competitive game I'm likely to be a bit snarkier, because I'm competitive and that part of my personality is attached to the domain and the relevant language. And so on. |
|
But it's missing explicit symbolic representation, and that's a serious limitation.
What's more interesting is that a lot of the behavior of "human minds working" is explicitly modeled into language. Because GPT implicitly models language, it can "exhibit" patterns that are very close to those behaviors.
Unfortunately, being an implicit model limits GPT to the patterns that are already constructed in the text. GPT can't invent new patterns or even make arbitrary subjective choices about how to apply the patterns it has.