[ypcx]

I think the question of "how much can it reason" can be made more specific as "how far away can it reason from the learned examples".

Increases in reasoning power should allow for much smaller usable models.

[sgt101]

Yes - reproducing fragments from various texts can look impressive, and could be useful in some applications - like creating comments on HN! (I give it a week before someone says "GPT3 has commented on HN and earned 500 Karma!!!"). But I don't think it can be a reliable problem solver or co-creator.

The fun bit is generalization. Create a pattern that hasn't been read before. Hard with GTP-3 because it's been given everything to read...