[TheUndead96]

I think this is actually the interesting part. It appears to understand some causality in spite of never being trained this. GPT-3 seems to be able to do arithmetic with small numbers, but begins to fail with larger equations. This seems congruous to how humans may internalise arithmetic. As far as we know, we do not have an ALU in the brain.

[cblconfederate]

We are also known for seeing patterns where they don't exist. If someone is going to make claims about the neural network's reasoning they should corroborate it with statistical analysis of its performance