Hacker News new | ask | show | jobs
by kungfupawnda 864 days ago
People have been scared of AGI for decades, such that it would take over and destroy humanity. Hail our robot overlords! My take is that it will do that indirectly by destroying the climate first because of the energy requirements. I find it chilling to imagine the possibility that any inevitable successful AGI would require humans to first destroy themselves. As in we are setting up the precondition for it. Just like how dinosaurs were wiped out so that the homo sapiens can evolve.
3 comments

I kind of doubt that. Much more likely in my mind would either be we go back into an "AI winter" or AI solves the energy crisis by solving fusion.
I got 'triggered' into this thought by thinking about the energy requirements of a system worth 7 trillion. A system which seems to require exponentially larger resources for progression.
is it more efficient to properly fund fusion research or give sam altman $7T and hope for the best?
Nobody is giving Altman $7 trillion and there isn't any evidence that he's actually trying to raise it (as opposed to suggesting that level of investment globally over time toward AI related infrastructure to support its build out).
imagine an AI paperclip maximizer, except now maximizing for success of fusion... so basically, turning little ol' Earth into the next Sun, oops.
I for one welcome our helium producing overlords.
Similarly AI will cost jobs but only because companies will overinvest in it at the expense of other parts of the business.
> I find it chilling to imagine the possibility that any inevitable successful AGI would require humans to first destroy themselves.

That's not the chilling thing. The chilling thing is there are people (mainly sci-fi addled software engineers) who would consciously choose to destroy humanity in order to create an AGI. It's like they read about paperclip maximizers, and decided to become one for <insert-scifi-concept-here-usually-agi>.