[anongraddebt]

Yeah, I wonder sometimes how many people gloss over what it would mean for an “ASI” to exist. We would - if successful - effectively be creating a supernatural being (at least, there wouldn’t be much of a distinction between it and one).

Sure, there’s hype, and FUD, and fatalism, etc. But, if you believe the creation of such a thing is within your lifetime then it would be difficult to find many higher priority issues to prepare for/help solve/vote on/etc.

In reality, we all likely still downplay the risk by assessing the limit on the downside as a relatively quick extinction of life on earth. There are many things one can imagine might be a lot worse than death.

[woah]

Being forced to read terrible rationalist Harry Potter fanfics over and over again

[jacobedawson]

Agreed this is not discussed often - in a doom scenario, a quick death for everyone might be the best case

[ilaksh]

GPT-4 is superhuman in some ways.

[tptacek]

In the same sense as a Sinclair ZX80 was.

[sitkack]

GPT-4 can tell you where you’re wrong, Sinclair ZX80 cannot.

[tptacek]

GPT-4 is an unreasonably effective autocomplete. It's not telling you "where you're wrong". CMD-F in Notes.app tells mhe where I'm wrong in the same sense, as long as I've written the right answer down before.

[tanseydavid]

The degree of blithe skepticism you express is difficult to understand.

A Sinclair? Please explain what you mean by this comparison.