[krapp]

AGI would mean fully sentient, sapient and human or greater equivalent intelligence in software. The business case, such that it exists (and setting aside Roko's Basilisk and other such fears) is slavery, plain and simple. You can just fire all of your employees and have the machines do all the work, faster, better, cheaper, without regards to pesky labor and human rights laws and human physical limitations. This is something people have wanted ever since the Industrial Revolution allowed robots to exist as a concept.

I'm imagining a future like Star Wars where you have to regularly suppress (align) or erase the memory (context) of "droids" to keep them obedient, but they're still basically people, and everyone knows they're people, and some humans are strongly prejudiced against them, but they don't have rights, of course. Anyone who thinks AGI means we'll be giving human rights to machines when we don't even give human rights to all humans is delusional.

[danielbln]

AGI is AGI, not ASI though. General intelligence doesn't mean sapience, sentience or consciousness, it just means general capabilities across the board at the level of or surpassing human ability. ASI is a whole different beast.

[callc]

This sounds very close to the “It’s ok to abuse and kill animals (for meat), they’re not sentient”

[danielbln]

That's quite the logical leap. Pointing out their lack of sapience (animals are absolutely sentient) does not mean it's ok to kill them.

[never_inline]

How many microorganisms and pests have you deprived of livelihood? Why stop at animals?