|
|
|
|
|
by krajzeg
1205 days ago
|
|
I actually find the first example strikingly similar to what would happen if a human was given a secretly broken tool. If somebody asked me: "Hey, what's the area of a room 1235 x 738m, here's a calculator?" and the calculator gave me 935420, I would just say "935420 meters squared" as long as the rough number of digits seemed correct (and maybe as long as the last digit was 0, but I think with a less mathy person that wouldn't matter). Should the calculator give me "3984" instead I would be like "wait, that's not right, let my calculate this by hand", which is what GPT-3 tried to do. It's just way worse at doing math "by hand". A very interesting anecdote and another article which makes me wonder how a statistical prediction model can come so close to actual reasoning while seemingly using completely different tools to get there. |
|
There is a theory of brain function (predictive coding, predictive processing), that posits that the brain works by predicting expected input from the senses and then comparing that with actual input. This doesn't seem a million miles from a language model operating on words rather than sense data.