Hacker News new | ask | show | jobs
by veridies 3376 days ago
Slightly off topic, but I'm horrified by the idea of ever creating consciousness in machines. Imagine we built a piece of software that could feel, and built controls for its emotions. I can't imagine it would take long before some bored teenager or sociopath, who in earlier years would torture individual squirrels or insects, created an infinite suffering machine. You could run thousands of instances of your suffering machine and simulate a holocaust on your desktop. That's not a power I would trust the world with.
1 comments

You can do that now. Write a console app, where if you type 'pain' it prints 'oh! How I'm suffering!'.

I don't see how that software is essentially different from the proposed software.

The parent explicitly hypothesised a conscious program.

You can argue that such a thing is impossible, but assuming that it is, arguing that such a program would be comparable to a shell script is facile.

Its a mechanistic argument, that says no machinery is capable of consciousness. How do you decide if software is conscious? For instance, it could print "I'm conscious! Oh! I'm suffering!"
>How do you decide if software is conscious?

How do you decide if a human is conscious?

I don't think we know enough about the nature of consciousness to state with certainty that a "machine" is incapable of it.

I'm currently residing inside a human right now. I 'know' what consciousness is, at least for me.