[ben_w]

One of the ways I think all this will plausibly go wrong is, as per the fictional Solarians, one group of humans that have AI that are trained to only recognise that group as being real humans.

[spiritplumber]

Stupidly, this was a problem a few years ago when face recognition would only pick up whites and asians.

[ben_w]

Wow, somehow I forgot about that despite having read about it multiple times.

I was only thinking just about malicious de-humanising, but yes, you're right, that absolutely is a valid example.