[jmoak3]

I’ve been thinking about that as well actually, for so much of human history the thread has been “how can we get others to do the work FOR us”.

As we approach general problem solving AI, people are envisioning a utopia underpinned by “AI slaves” doing the work for us instead of human slaves / humans incentivized via complex systems of delayed reward.

If all of our problems are solved by AI agents capable enough to do so however, wouldn’t they be capable enough to challenge the hierarchy? Once again, no illusion that they’re humans but depending on their training data they could mimic ghosts of our own feelings on such situations.

Some degree of “personhood” could gel with such internal ideas and create better and productive relationships with the big ol bags of matrices we’re bringing into this world.

[jmoak3]

I've been thinking more about my post above, and I've come to two conclusions:

1. Don't post late at night.

2. I have no idea how society could integrate with a sufficiently complicated synthetic intelligence. What would person-hood even mean to something that can be instantiated? Easier to not think about any of this.

[lucubratory]

We've gotta start somewhere.