[LukeB42]

What do you do when this software discovers it's rewarding to compete with you for physical space?

The problem with AGI is it'll implicitly have to model the entities it interacts with and that may present two challanges:

1) Developing robust strategies for managing an AGI discovering a greater reward response from defecting than for cooperating with people / developing strategies for managing scenarios in which a quorum of AGIs discover it's rewarding to collude to the detriment of humans / cellular life.

2) The tractability of maintaining one language model per entity across channels.

The actual implementation could be done by plugging a handful of related techniques we've developed over the past couple of years together though.