[hotpotamus]

I've often wondered what an AG(S?)I would want, and I tend to agree that most of our desires come from our innate biology and most of our reasoning goes into justifying said desires. Given that an artificial intelligence would be on an artificial substrate, it seems very difficult to imagine what, if anything, it might desire.

These are philosophical threads that I'd honestly rather not pull, because I suspect that in the end, the nihilists are most correct, and I just got into this business because I thought computers/video games were cool, but it seems that collectively we insist on it.

[reducesuffering]

Most of the actors involved in building AGI are incentivized by money (startup founders, VCs, employee stock comp), so $10 says what AGI gets instilled with is “how to make money line go up.” We’re going to get ExxonMobil Philip Morris on omnipotent crack.