[Cafey]

­­>But even humans do things that they can't explain

That is actually very interesting. I would even extend that sometimes, humans know the decision they are making is stupid/not the right one but the reward for taking that bad decision is worth it for him. Translating that flawed behavior into an AI must be terribly hard.

[TeMPOraL]

Moreover, often humans seemingly "can't explain" something - or invent nonsense explanations - because the act of actually explaining their reasoning could expose them to bad consequences, often social ones.

Question: why didn't you tell me you're going to a meetup after work?

Provided explanation: because I was so busy I forgot about it.

Real explanation: because I didn't want to have a conversation about it with you.