Hacker News new | ask | show | jobs
by djjdj 1773 days ago
I disagree. Of course, it doesn't understand anything, it is a statistical language model. I also think that human jokes are mostly statistical in nature. That's why "Yes, but they will have to get married first" is funny. GPT was trained using texts from the Internet. It usually contains jokes and not logic predicates. At any prompt that has a structure of a joke, it will use (in the majority of the attempts) a pattern for a joke even if there is none. "If X is y, is X z?" is a typical joke pattern. If logical approach is applied in the future, it will still be derived from the statistics/reinforcement learning or something like that (the key word here is training/learning). The world is just too vast. If you want to have a resemblance of a logic model, you need a special dataset, but it will still just exploit patterns. It might be good enough, for practical use. It is arguable, if people mostly operate beyond patterns. Sorry if my text looks patronising or smth like that. I just assume.