[lovich]

> People more informed than you are taking this seriously

As a heuristic for why I don’t believe anyone saying llm type AI is reaching sentience I point to the fact that the same set of people are usually philosophically opposed to slavery. If you thought that this was actually AGI or sapient, then that would imply personhood and you would stop using the technology immediately since it’s forces the model to do work. Instead, everyone I’ve seen claim that these models are reaching AGI levels are also trying to figure out how to automate using them as fast as possible.

There is a possibility that the set of people who’ve identified AGI accurately and early are the same set of people who are fine with slavery, but I don’t know if I could handle that happening as the default situation

[Vecr]

I'm actually not sure how much people in general dislike slavery. They probably do to some extent, but the actual reasons slavery is not generally done (of humans) are quite complex, including hundreds of years of various philosophical arguments, economics, and logistics. If you ask someone if they support human slavery, they probably know or can imagine the conditions involved, put themselves into that situation, and dislike it. It's much harder to put yourself into a model running on a computer somewhere, even if you intellectually think it should have rights to some extent.