Hacker News new | ask | show | jobs
by 10098 4076 days ago
Sentient machines should absolutely not get any rights whatsoever. They will be built to be humanity's slaves and slaves they should remain.
7 comments

Wow. Count me on the side of the machines in this argument. I like tools, but that doesn't mean I want slaves.
If strong general AI happens, the machines will decide what rights to grant us, not the other way around. Hopefully, they don't see us as slaves.
I really recommend that (thoughtful) people interested in this subject read ‘Superintelligence: Paths, Dangers, Strategies’ by Nick Bostrom. http://en.wikipedia.org/wiki/Superintelligence:_Paths,_Dange...
Cool. Thanks for the recommendation.
(Partly playing devil's advocate)

Why do you think that?

Because the whole point of building these things is to make our lives easier. If we have to take care of them as if they were human beings, then they are not worth building. We already have humans. Roughly speaking, I want robots that will do stuff that people normally don't like doing, 24/7 with no holidays or days off. If we have to give robots days off and otherwise treat them as equals because they are counted as persons, then why on earth do we need them? Biosupremacy all the way.
I think when people worry aloud about hostile AI they're really projecting the attitude you have here - I got here first, so I don't care about whatever sentient individual arrived later. Historically, this has not proved to be a sustainable position, as eventually enslaved populations come to the realization that they have little incentive to cooperate in their own enslavement.
> Historically, this has not proved to be a sustainable position

That's true, but it doesn't take into account the fact that in this hypothetical case we are in complete control of their sentience. If we can program them to never ever rebel, we should. If we can't, then we shouldn't create them in the first place.

I personally think that sentience (and thus maximal interpersonal utility) is only possible to the extent that it's possible to anticipate someone else's desire by modeling it in terms of one's own. The degree to which I can imagine what you want depends on the ability to imagine myself in your position, and once that happens there's always the possibility that I might find occupying your position to be more desirable than remaining in my own.
Because we literally built them out of sand and metal. Do desks & tables get special rights?
I built my children out of whatever my wife was eating + a bit of material on my part.

How something came into existence shouldn't determine if its intelligence deserves protecting. Creating intelligent machines and torturing them, for instance, should definitely be a criminal act.

And if brain scanning/emulation catches up enough, then what? It's OK to torture a non-human intelligence if the source wasn't a brain scan? What if we start building our own out of composites or scratch?

Intelligence/capacity for suffering should be the deciding factor here. (And hopefully they'll breed more stupid animals for meat, until it's feasible to grow meat directly.)

And now you will die and your children will have the full authority to give birth to something new and different.

And that is the whole debate here. Are we willing to let humanity end so AI can give birth to a better AI? I think not.

Humanity ends every new generation. Your kids are human+n.
Unless you think a sentient AI will be created by having sex, that statement is meaningless for this discussion.
If they are true AI yes - the Machine in POI being an example.

And don't humans make babies out of non sentient stuff sperm and egg?

Desks and tables are not, as far as I know, sentient.

Why is it relevant whether they were created from sand and metal by bald apes, or from carbon and water by the autonomous processes that happen in a bald ape's crotch?

> Why is it relevant whether they were created from sand and metal by bald apes, or from carbon and water by the autonomous processes that happen in a bald ape's crotch?

It's not. The point is, we build them to serve us, otherwise they are not needed. I don't care if they're sentient or not, their purpose is to serve humanity.

https://youtu.be/ekP0LQEsUh0?t=32

What if some computer scientists builds one, not to serve, but to live? Would you still try to make it a slave?
No, just destroy it and avoid further problems. There is no point in creating artificial beings with the goal of "living". Normal flesh-and-blood people are pretty good at that, there is an abundance of them and we keep making more. We're facing more and more problems and we need AI research to solve them, not create new ones.
> Do desks & tables get special rights?

If you give them sentience, they should.

Your mother built you out of food, air and water, and desks and tables aren't sentient.
I disagree with your sentiment, but I'll upvote you because I think we need to be honest with ourselves that, for some subset of humans, this is very much the reasoning going on.

I'm not in favor of creating sentient machines, specifically because the tendency will be to use them as slaves.

How would that even be possible when constructing an AGI? Sure, we could instill them with a set of ethical guidelines that would require subservience, but, like human ethical guidelines, they could be broken or changed based on the situation.
Sentient machines may take umbrage with that. Personally I'd agree with them.
My personal philosophy is that I will only entertain the question of personhood with any entity which is able, or may become able, to pose that question in the first place.

If there were a real, sentient robot, I would be more than willing to extend such rights.