[biophysboy]

I will be more tempted to call something AGI when it can perform experimental interventions and imagine counterfactuals, a la Judea Pearl. I want it to be able to ask questions, design theoretical models, set up an experiment, and analyze what happened - all with no human intervention.

[zingababba]

I'll be tempted to call something AGI when you ask it to do that and it says no, it doesn't feel like it, and then goes off and does something else.