[rerdavies]

With you mostly, but wondering how "suffering" got into the equation. Do humans lose consciousness if they aren't suffering? No. Just a reminder that the question is not whether they are the same as humans. Obviously they are not.

[yencabulator]

One way to think about this, and not get hung on the word "suffering" that may be too corporeal:

Could a future AI thing have its own drives? (As in https://en.wikipedia.org/wiki/Drive_theory) We could probably make a current-day LLM already exhibit basic outward signs of this with just a system prompt. Now consider adding memory that over time retrains the weights, allowing for behavioral drift.

Would depriving it of fulfilling those drives be acceptable?