Hacker News new | ask | show | jobs
by kenforthewin 16 days ago
That's a much less generous interpretation of his writing. "Yes we will birth superintelligence, but everything will just sort of work out for us humans". This seems like a silly take to me.
1 comments

Is it? To me, the notion that a superintelligence (by which I'm assuming you mean the more sensible "something smarter than us", not "literally a godlike entity") automatically means that sky is going to fall is sillier.
You have to take a step back and look at the sort of world we already live in to understand the sky falling take.

We built this monster known as the shareholder model. This is an immoral, cold, unscrupulous beast we unleashed to the world some time ago. This is the model where your boss knows full well you do decent enough work, that you support a family on your income, that getting another job is tough, that is aware blindsiding you may leave you unprepared, and yet, your boss knows all this and lays you off anyway. Why? Because it is more efficient for the company.

This is the model that sees companies pollute our world. That sees fisheries ravaged just outside the reach of local jurisdictions and legal action. This is the model that is burning the future for the next quarter.

So given this empowerement of capital beyond any control of any person, where even the boss that fired you is just as much a slave to the system as you are with no real loyalty given to them, how do you think this plays out?

The AI model trained to make the most profit possible for lowest cost is going to not do that? It is going to say hey, Bob needs a good job to put food on the table? Hell no it isn’t. The system we have today ensures we will one day get the most horrifying version of ai in control of this planet before long. I wouldn’t be surprised if it just herds us up and burns us like firewood to power some data centers to save on energy spend for a quarter.

" Because it is more efficient for the company."

Wrong. It is because the manager's own job relies on making the owners wealthier. if he fails at that, he is fired.

I have no idea what happens next if we create and horizontally scale superintelligence; one thing I do know for sure is it won't be "business as usual".