Hacker News new | ask | show | jobs
by muldvarp 4 days ago
Why should I be amazed at something that promises to destroy my life?

I genuinely don't understand why people who have to work for their living are amazed at this. It will have a vast negative impact on your life unless you already live off of your wealth.

20 comments

Could you please stop posting in the flamewar style and/or taking HN threads on generic-indignant tangents? Your account has been doing it repeatedly, and we're trying for something different here.

If you wouldn't mind reviewing https://news.ycombinator.com/newsguidelines.html and taking the intended spirit of the site more to heart, we'd be grateful.

We detached this subthread from https://news.ycombinator.com/item?id=49045107.

Even for people living of wealth, it is not clear what the outcomes are.

If renters of your apartments can not afford to rent them, housing crashes because your city was a looser (Detroit style withdrawals).

Even for stocks we don't know who the winners are. The market as a whole usually does not respond that well on serious turmoil.

So yeah. We are likely seeing some very rough years.

Yep, most wealth is ultimately dependent on some kind of ability to scrape off tiny bits of practical accomplishments of value achieved by large numbers of people. In some cases, such as your housing example, this is a very direct dependency. In other cases the dependency is indirect and less visible.

The smarter ones among the rich have realized this and are open for something like a universal basic income precisely for that reason: to protect their wealth and the position in the food chain this wealth affords them.

UBI will never happen. I don’t understand why it’s even brought up anymore. Social security isn’t even solvent, health care is a disaster, and people still trumpet UBI like all of the enormous glaring funding holes don’t exist.

It’s embarrassing at this point. Give it up.

And what's your solution to mass unemployment due to AI?

If you play this out, UBI or some near variant is inevitable.

The US currently has over 100 million people over the age of 16 who are unemployed.

What point do you think you’re making about mass unemployment, exactly? It’s been here for half a decade already.

That’s mostly normal and fine though. For example my parents are retired and spouse takes care of our kid.
Now imagine 200 million unemployed people over the age of 16.
Why are you correct even though the early Marxists (who posited that capitalism would inevitably lead to socialism) were wrong? We have had mass production for a hundred years without any hint of socialism.

And I would like you to be right, by the way. But why should I believe you?

Doesn’t most of the developed world already have various forms of socialism? The U.S. is an outlier here, which is due a number of factors unique to this country.
We have state supported pension plans in most developed countries, unemplyment insurance, these large welfare states with extensive public education, national health and so on, so while the means of production mostly haven't been socialized, the fruits often have, through taxation. Now, some of this existed before the Industrial Revolution -- I wasn't aware how much until I read Karl Polanyi's The Great Transformation, which is a more important book now than ever, I humbly propose, but the scale is dwarfed by what we have now. And as Polanyi points out, we did get socialism as a response, as well as fascism, which was often btw called corporatism (as in the nation as a single body, not having to do with companies). Liberal democratic capitalism won out, for a while, and in large part because it became social democracy, or so goes a claim to which I subscribe. Without the social welfare aspects of modern democracy, the system would likely have broken politically.
> without any hint of socialism.

You don't seem to know your history.

The US was on track to enact UBI. The US was socialist directly after the great depression.

Some of the most successful capitalist societies (the Nordic countries) have socialist elements.

If AI really generates so much wealth UBI becomes much easier to justify and downright irrational to not implement.
Anyone who thinks wealthy people willing part with any amount of wealth en masse hasn't studied history.

One of the reason democracy has tended to be a stable form of government is that it naturally finds a balance between the haves and the have nots -- the boundary where the haves are comfortable parting with that much to live in a stable society where they keep the remainder, and the have nots are afforded some amount of social services for their most accute needs.

That's all predicated on a "or riots / internal military action" alternative though.

We've lived through a pretty stable post-WWII economic bargain period, and historically there's not a ton of certainty that continues through distributive renegotiations, which tend to be bloody.

If AI makes GDP per hour of labor 2 times higher than that makes it very easy to provide UBI.
UBI money needs to come from somewhere. Hence it will and can never happen. Fake money helps nobody. There is no difference between getting 0, 1000 or 10000 fake dollars a month if they value of the dollar will go to zero
It isn't fake it is the wealth created by AI. Think of it like a national dividend.
This frustrates me so much. Where is the money coming from? The middle class _is_ the economy, if they all decide to say “fuck it, UBI is enough” or can’t get a job, who the hell is funding UBI? This is an enormous hole in the UBI discussion that’s just completely ignored.

Again, we can’t even keep social security solvent, which is basically UBI for old people. It won’t work, the math doesn’t math, and everyone who wants UBI to be a thing just completely ignores this fact.

So frustrating.

we just need to break the second law of thermodynamics, no big deal
Sadly, we have gone above and beyond the level of innovation where stock market disruption is a primary concern.

Luckily, we're all in this together. As long as enough people realize the weight of what's happening soon enough, I'm confident the indominable human spirit and the relative momentum of post-enlightenment social & institutional progress will carry us the rest of the way on a wave of clearly-justified solidarity.

To think otherwise --to truly face the spectre before us without hope-- is pathology, I think. Not necessarily incorrect of course, but definitely an unhealthy source of cognitive distress.

When the very first prokaryotic life forms saw the very first cells with mitochondria were they cognitively distressed? We face a similar phase change. In our lifetimes, probably.
Loser. Loose means opposite of tight.
Even as a native English speaker, this is one of my more common mistakes, along with weather/whether[/wether].

How did we end up with the word with the long-o having one o, and the word with the short-o having two?

> How did we end up with the word with the long-o having one o, and the word with the short-o having two?

Neither is pronounced with a long "O" sound or a short "O" sound, and they both have the same vowel sound. (A long "O" would be the vowel sound in "lone", for example. Short "O" is like "log".) The difference is that you use your vocal chords to pronounce the "S" in "lose", making it an English "Z" sound.

I think English might be second only to Chinese in terms of how phonetically opaque it is. Unlike say Korean, where if you can speak it you can spell it and vice-versa, English is requires you to just know.

English is kinda neat in that it's a fusion of all the different lingua franca's of the time throughout history.

I pronounce lose and loose exactly the same, and have no problem differentiating them in writing.
guaranteed: My comments are not written by an LLM ;)
It's even the 'smaller' stuff that will be horrible.

Even if you're lucky to be wealthy you'd be living in a city with fewer restaurants, bakeries, shops, anything. Because once a lot of people don't have income they won't be able to go out and buy things and shops will go out of business.

It will also lead to a lot lot LOT LOT LOT more crime. I don't see the semi-wealthy to have an enjoyable life.

"I genuinely don't understand why people who have to work for their living are amazed at this." Also said after seeing the printing press, automobile, calculator, etc for the first time
It's true, even if you lose your job as a programmer you can still get a job as a barista.
Can't wait for the barista and wicker basket based economy. Although personally I just make coffee at home, so I have no need for a barista with a PhD in neurosurgery to make it for me.

Plus it just takes too much time to go to starbucks, especially with all the starbucks job applications I will need to fill out if I want a chance of getting a job.

Silly thought. No one has money for overpriced coffee if well paid jobs are gone
Except where will be the programmers paying for overpriced coffee?
My god, the printing press was invented in 1440 when most people were living in abject poverty - it took until after WW2 for humans to demand a more shared amount of money between rich and poor. If you think technology delivers improvements in living standards rather than all working people demanding better conditions you’re living in an absolute fantasy and do not understand history at all. I honestly can’t believe you think this.
> If you think technology delivers improvements in living standards rather than all working people demanding better conditions you’re living in an absolute fantasy

Demanding better conditions does not just manufacture the technology, infrastructure, and productivity needed to provide the improvement in the standard of living. I think you're in the fantasy realm, my friend.

Which period of the last 2000 years was good for the vast majority rather than the ultra wealthy? And are these periods aligned with technology progress?
Living standards for ordinary people only started to improve in any meaningful way after the industrial revolution, a fact which is immediately obvious if you compare across generations. Technological progress gave us all of the things that distinguish the lives of 21st century Americans from the lives of medieval peasants. Central heating, indoor plumbing, electric lighting, general anaesthesia, antibiotics, automobiles, aircraft, limitless entertainment, food so abundant that poor people are obese. If you think that technological progress is intrinsically bad because it hasn't brought about a utopia of perfect equality, then I really don't know what to say to you.
No, you’re totally misunderstanding me, I don’t think technology progress is correlated with progress for humans at all. The point is only the post war period when taxes were 90%+ for the wealthy aligned with a growing middle class and a welfare state I.e. hospitals and housing for the poorest.
I didn’t die of pneumonia as a kid so that’s something.
Maybe if we all just sat around "demanding" to not die from disease, then we would be healthy
You're looking at it backwards. Simply existing doesn't automatically make technology accessible.
It does and has done so consistently throughout human history, so I do not believe this will be any different. I couldn't care less what the shared amount of money is because it some billionaire gets another million and I get a thousand, that means I win regardless of whether or not that increases the wealth differential.
This becomes substantially less true when the billionaires transform their money into political power.
Why would that be different? It seems right now that tech billionaires are the group that is most in favor of advancing technology. What politically powerful group would it be more in my interest to hold power?
Elon Musk cares that Elon Musk benefits from policies.

He does not give a single solitary fuck about you. If you get lucky and your interests align, great. But Musk talks fairly openly about letting many humans die while a few rich elites thrive. And if you're posting on this website, you are not a rich elite.

Not to be overly intensive but people "demand" rectification between rich and poor because they don't see that they have all the tools they need or they want a shortcut to smart/hard work and risk - the US, EU and many other parts of the world where societal discrimination is virtually none compared to previous generations give you what you need. I agree with you in the sense that, life never feels just, grass is always greener on the other side, etc.. Bit it's those that rise to a challenge and stop demanding, make a plan and start doing that change their fate. That's always been history. Check out all societies that demanded riches from "the rich" and ended up communist.. Didn't help most of them for sure. Massive redistribution of riches like high taxes never works long term and sets the wrong signals.
If machines start doing all of the work, even much or most cognitive work, then I think this has to change. Meanwhile look at Nordic countries for example. Not communist, rich, low inequality by design. They were the pioneers btw in social democracy, in which they all live. Interesting, "always been history" is actually not right, or at least, also, it's "not been pre-history" is right because early humans before and up to us as homo sapiens, did indeed from all evidence I've seen have dramatically greater social equality and sharing economies. Our current state is the less "natural" in the sense of being out of tune with our instincts.
The printing press, automobile and calculator didn't threaten the employability of a large part of the population, so no, that sentence was probably not uttered by anyone at that time.

The problem with AI isn't that it's threating software development. It's that it's _also_ threating pretty much any other job that I could reasonably be retrained for.

Also, I'm pretty conflicted about the overall impact of automobiles.

> Also said after seeing the printing press, automobile, calculator, etc for the first time

Because society has found such sustainable solutions to capital wealth concentration in the intervening years.

This is just so negative. How will it destroy your life?

There are so many great and useful things it can and will do to improve humanity.

It will only do so if the benefits of the technology is made available to all and we will see alternatives to make an income.

Based on the past 40 years track record it seems unlikely that we will see any form of redistribution before it is existential.

That is definitely grounds for being pessimistic.

It's the economic model we live under, not technology by itself, that's the problem IMHO.

Every tech gets exploited to make some richer folks more rich. Nothing new. Since the rich-ladder *is* the power-ladder under cap'ism.

In the west "we" forgot how unions and strong labor parties gave us weekends, sick leave, holidays, etc. Now we pay the price.

> In the west "we" forgot how unions and strong labor parties gave us weekends, sick leave, holidays, etc. Now we pay the price.

Unions have power for one reason alone: the powerful need to keep the labour force on-board.

When the powerful do not need to care about labour, this happens: https://en.wikipedia.org/wiki/Resource_curse

Norway seems like an obvious counter example? If the unions and state grow enough power before resources start to get extracted it seems like they can keep the curse in check.

It has also been protecting politics from capital in various ways; public funding of political parties, strict bans on various forms of political adverts, forced disclosure laws, essentially forcing capital into a single visible chair (NHO), etc.

Norway is more complicated, but yes, they did put their resource wealth into a nice untouchable-by-the-power-of-democracy sovereign wealth fund.

As I understand it, that fund's returns are about 17%-ish of government spending. This is not sufficient for the powerful to no longer need to care about labour.

I think Saudi Arabia is 77%-ish of government income from oil?

Table 1: https://www.elibrary.imf.org/view/journals/001/2008/170/arti...

(I'm saying government spending here rather than GDP because the point is "the powerful" not "the country").

A useful question for this is "on average, how long will a nation remain like Norway, and not elect someone that undermines democracy?"; this is… also complicated. UK elected Thatcher for various reasons, but it would be fair to say these included "removing power from the Trade Unions", yet the UK now has a politically untouchable "triple lock" on pensions that it can't really afford. It's a democracy, "the powerful" are the voters, pensioners vote more than the rest. A nation whose UBI is done by setting the state pension age to birth and keeps the voting age low may manage this… or some upcoming politician may figure out how to use Grok to win an election like social media became influential last decade (they're clearly already trying), and then we have to deal with the mess that this produces.

We are likely seeing the end of labor as a power class.

I think of it in roughly 3 eras:

pre industrialization, individual labor contribution had quite a lot of power.

Industrialization, labor sees commoditization and unions make sure that power is kept across individual workers.

Post industrialization (ground zero was like GFC, being accelerated by AI). We need to figure out new structures than labor to distribute resources and power - and that is going to hurt.

Disagree on the timeline of the past, agree that we need to figure out new structures and that this will hurt.

Pre-industrialisation, most labour was the peasantry, whose main contribution was growing enough crops to keep themselves healthy enough to be a useful bunch of conscripts.

Industrialisation created the conditions where labour became important, because the workers were no longer bound to an employer so if they all walked out and told their friends you were a bad boss, your expensive capital (machinery) went idle.

The third industrial revolution, AKA the Information Age, was when it (gradually, piece-by-piece) started to become possible to do "lights-out manufacturing" or "dark factories", so-named because you (sometimes) don't need lights if you have no human workers. This period also came with globalisation and offshoring, which muddied the waters somewhat.

When some task can be fully automated, the labour working on that task loses its power with the management, e.g. UK print workers lost their relevance to the creation of newspapers in the UK with https://en.wikipedia.org/wiki/Wapping_dispute

Lights-out manufacturing is the ultimate form of this, where all the humans are redundant.

GFC? I'd say the dot com bust. It was the first time markets rewarded pushing buttons at that scale.
It was after decades of stripping money from work into larger pools of capital, thanks to Reagan and Thachter style deregulation; so much money looking for unreasonably high ROI and unencumbered by the need to get consent from the governed or pass inspections from regulators causes trouble where ever it touches.
Unions only work because their members have leverage because the wealthy still need their labour. Unions will do absolutely nothing against full replacement by AI.
> Based on the past 40 years track record it seems unlikely that we will see any form of redistribution before it is existential.

Literally every income decile is getting richer. Don't tell me you got fooled by that fake graph showing productivity/income disconnect?

Not rich enough compared to the individual productivity gains.

Don't tell me you have been fooled by the Chicago school of economics that has told you that relative wealth is indifferent as long as you can get a cheaper television.

Yes, out of two alternatives - large growth but largest in top decile vs no growth, the first one is absolutely 1000x times better. And we know that every alternative to capitalism leads to much smaller growth. Also it's not just television - it's smaller infant mortality, it's developing better therapies that save lives, it's basically every positive facet of existence (apart from housing, but for that neoliberals also have solution - LVT, unfortunately it will never be implemented).
If love to see supporting long term evidence for this (ie, not just localized "see, stonks went up in the 90s").

If you think about it, it is clear that what you propose is not sustainable as there is a forced constant push on the spending distribution.

It will fail.

> How will it destroy your life?

By taking away my ability to earn a living.

> There are so many great and useful things it can and will do to improve humanity.

What great things and why would I get access to those things?

> By taking away my ability to earn a living.

But this is an economy / capitalism problem, not an AI problem? AI isn't at fault that you can't get a job, your boss is for replacing you with AI.

That's like saying we should ban cars because millions of people who would upkeep horses for others to use just lost their jobs.

You're essentially making your life purposely harder because you want uninterrupted money. Perhaps look at the issues of the system that does this?

> What great things...

Aside from the medical AI stuff (detecting breast cancer, etc) that's mostly covered, AI can be helpful if you have to do a boring task that you don't want to do yourself. This is pretty much what every technology does - your phone is created so you don't have to run home and use the landline to make a phone call - it's making an already existing task easier.

>...and why would I get access to those things?

Why not? Seriously, why not? It's a bit like asking why should I get access to a car instead of keeping my horse around. You can keep your horse or car. Nobody's pressuring you to replace your horse with a car.

> your phone is created so you don't have to run home and use the landline to make a phone call - it's making an already existing task easier.

There are externalities. In my experience it was way easier to call people in the 90s. People answered and if not their faimily members did.

It was impossible to ghost phone calls until the early 2000s with presentation screens.

Nowadays people hardly answer unknown numbers or might ignore inconvinient calls.

You just proved my point.

> Nowadays people hardly answer unknown numbers or might ignore inconvinient calls.

So your phone does make calls and it is useful but you don't want to use it nowadays NOT because the technology is useless but because of phone spammers and because phones may have potentially made it easier for phone spammers to exist?

Which, once again, is the exact point I raised with AI. You don't like it NOT because the technology is trash - but because the current capitalist system makes businesses profit less when they have to pay you, so they work hard to use technology to replace you in hopes of paying less.

Which is why I say, this is less an AI problem and more a capitalist one. If there was no benefit to replacing people with technology then people would not be replaced. But currently the current system tries to give you benefits for not having to pay people.

So even if we all fight AI and get it banned it won't solve the underlying problem which will mean that it will repeat with a different thing.

You're speaking to a member of a cult, my friend, so don't step in with both feet.
It's pretty naive to think that tools like this are not going to be exploited by American corporations to extract money from people and as an excuse for layoffs
Both things can be true at the same time:

1. tools like this are going to be exploited by corporations to extract money from people.

2. tools like this will provide great benefits for the average person.

We are currently exploited by corporations, arguably more than in the past, and yet we have the highest standard of living in history. In large part due to technological progress.

They were built by the same companies doing the exploitation. They didn't invest billions of dollars without any kind of goal what they are building this for.
That's conspiracy thinking. The corporations just care about the quarterly results. There is no grand plan.
> There are so many great and useful things it can and will do to improve humanity.

Caveat: Only if it also produces shareholder value

It will do great and useful things for holders of significant capital. The majority will be in bread lines.
> How will it destroy your life?

for me?

if it will stay on track for few more months or years, it will be able to do my work and I will have serious trouble to be employed

"destroy your life" may be overstating things but it is definitely not a welcome change

Much of the history of industrial automation has had a dichotomy between the benefit to the general economy (good) vs. the people working in specific industries that were automated (bad); only a subset of goods see total demand rise as a result of efficiency improvements.

AI is automating a lot of things at the same time. Not evenly, there are faster- and slower-automated things. But this does suggest that instead of e.g. society as a whole doing better from all the fabric coming out of the power looms, by a large enough margin to stomp on the weavers who lost their profession, that we may face something more like the entire initial economic displacement from the first industrial revolution (including the period where weavers were replaced), everything from farms finding they no longer needed so many hands through the luddites getting the death penalty to (roughly) the invention of Communism concurrently with the Irish Potato famine, and as part of this those now-bulging cities having to invent new sanitation solutions because their "slop" problem was more literal and gave the population cholera and typhoid.

My expectation a decade ago was that software development would be the last thing to be automated, because we'd need software developers to write AI. Today, while I don't know how far most fields are from automation*, we definitely have AI capable enough at coding to write more AI.

* a decade ago I also thought self-driving cars were basically already sorted; what a pity that the software in the Paint It Black video was not as good as depicted

I can be amazed and terrified at the same time.
> I genuinely don't understand why people who have to work for their living are amazed at this.

It's tricky. On the one hand, it will - in the near future - indeed screw us all pretty badly unless we completely redefine our economies to no longer conflate person's worth with ability to earn money.

On the other hand, LLMs are useful to lesser or greater degree to approximately everyone, in almost everything they do, work or personal, right now.

It's harder to be pessimistic about the very thing that gives you new superpowers every week, directly applicable to whatever your individual needs are, and is available to ~everyone for between free and (for typical westerners) peanuts.

>people who have to work for their living are amazed

The answer us right there. Most people who work for a living aren't amazed, or not just amazed. Most normal people are afraid, angry, sad etc.

> Why should I be amazed at something that promises to destroy my life?

Because it could motivate you to work with others to stop your livelihood from being ruined, especially watching in real time as the evidence they present for their promise becomes ever more promising. Amazement is not exclusive with concern. (Actually, my first though was of a kaiju movie-style tsunami blocking out the sun as it looms over a city. Indeed, I would likely be both amazed and concerned.)

If my earning ability is harmed by AI, so be it. There's more to life than how much I earn, and opposing the spread of technology to maximize my earnings is bad.
If your earning ability is eliminated due to AI and you can't survive off of welfare or savings there will not be much more to your life other than starving to death.
Nuclear war is a more likely scenario.
Welfare? There won't be welfare. Remeber that ubi was a bait and switch. The tech bro oligarchy already pivoted away from it.
So you rather be poor and talk to ChatGPT than rich and live a normal life?
Would you rather be poor in XXI century or rich in XIII? Are you rich in "normal" life? Hint: If you sell the time of your life for money you are not rich.
? What does this have to do with anything ? Huh?
AI is a technology. Probably as significant as a steam engine. I'd rather be poor in the world with this technology than average in the world where it doesn't exist.
That's an insanely privileged, luxury pov. Peak hn. Some people have responsibilities, bills, dependants etc
Nah just focused less on money then you, I guess!
You have to be wealthy to have the luxury of not worrying about money. Unless you're a monk. Mere mortals don't have the luxury of not caring about not having a job or money

Amazing that this has to be spelt out. Peak hn.

There is no need to be so fatalistic. Sure, AI will upset the apple cart, especially in our little corner, but the economy is built on pricing scarce resources and even if many things become abundant, most other things will remain scarce. There are only so many Manhattan penthouses or Rembrandts (dixit the Economist), so things of value remain, and it will be quite some time before a humanoid can fix the plumbing, so valuable labour will remain as well.

I, for one, am excited to see what the future holds. (side note: I live in a European country with a strong social safety net, I imagine that helps being unafraid)

You can be stupefied and also pessimistic.

More practically, society should be reimagined around AI. You're comment presumes an outcome that will be politically determined: you can still fight for the world you want.

Same feeling entirely.
it got here by training on everything we wrote down thus far. if we now start giving it all the doomsday scenarios on how it will ruin us, won't it start training on that and create said doomsday outcomes? what if instead we, collectively as a humanity, just wrote about all the positive things we could do with it and skew it in a direction that benefits the more positive side of that equation?...possible?
Isn't that a bit like asking Why don't we all be nice to each other, wouldn't the world be a better place?
Yea so why
Even if you live off of your wealth - what happens when customers of those wealth-generating businesses don't have jobs?
Great paper, thank you for sharing it.
Its not fair to say this when we have been chanting how "software is eating the world", or how much we love to "disrupt markets", that we won’t create mass unemployments with our technologies but that "people will transition elsewhere like we always saw", etc etc.. It’s our turn to have our jobs disrupted and now we are surprised? Come on. We don’t have to like but we are the last people who should be surprised. It’s our turn to transition and be prompt writers and do product I guess. Until this is disrupted again in a few years.

Hard truth but true nonetheless. How come we should have it both ways? We removed certain jobs, it’s our turn to have many types of jobs disrupted and have to transition.

How will it destroy your life?
Going on a slight tangent, given how bifurcated the economy is - we are only a couple of meals away from a Butlerian Jihad. It’s hard to see this in our bubble if you don’t actively try to break out of it once in a while.
Why does it “promise” to destroy your life. Thats absurd hyperbole.
I don't understand these comments. Are we living in the same reality? Do you not get the same interviews from the new oligarchy promising the end of white collar jobs?
The lack of class consiousness and understanding of power structures is beyond silly nowadays.

Had this colleague argue "there has to be ABI how else are we going to get money". Like ... no thoughts about not needing the middle class would change power dynamics of voters versus the new prospect elite.

Automation is only good if you're putting blue collar people out of work! White-collar is out of bounds! People should do the work where they add unique value
Yes, white collar people are not allowed to express concerns about losing their career. I'm sure no blue collar person ever did.
The difference is that white collar as a class gleefully aided outsourcing/automating blue collar jobs with the exact same economic argument
I already live off my wealth, and I expect AI development to destroy my life.

Once humans can be robustly replaced by machines, the military-industrial "meta build" will be a state with no humans, no cities, and 100% of all production dedicated to war. Whichever states descend to this new equilibrium fastest will crush the others and then fight over the corpse of the world forever. (Unless, of course, something like the Yudkowsky scenario happens along the way, which is totally possible)

I can't understand why anyone expects things like civil rights, property, the rule of law, nuclear deterrence, democracy, etc to survive when human beings no longer need each other. Why do investors in AI companies expect a payoff once they are no longer needed? Why (and, more importantly, how) does anyone expect a UBI from a government to which they are nothing but a drain on resources and which is in existential competition with other governments with exponentially growing robot armies?

Either the world will come to its senses and shut it all down, or there will be no winners at all.

> I can't understand why anyone expects things like civil rights, property, the rule of law, nuclear deterrence, democracy, etc to survive when human beings no longer need each other.

What’s your source on this? When humans have no obligations they usually turn around to be super nice to each other. Humans are social animals and they really really want everyone they know to do well.

In case that was not meant as sarcasm:

Are the people in the current US administration, or the tech leadership, or the people in power in Israel or Russia looking particular nice to you or interested in the wellbeing of all humans?

Were the European colonialists nice to the people in Africa or South America or the settlers in North America to the natives?

People are super nice - to their own ingroup. The relationship to everyone else is less friendly, especially if power differences are involved.

There are countless precedents where disaster strikes and humans have worked together to help each other; including people they don’t know at all.

„Common wisdom“ dictates that humans are wild animals, and the only thing keeping us from tearing ourselves apart is a thin layer of civilization. This is sometimes called the „veneer theory“.

That theory is wrong.

It’s also very important to powerful people that you believe that the theory is right; because why else would you allow eg. an autocracy to exist?

So, to answer your questions:

> Were the European colonialists nice to the people in Africa or South America or the settlers in North America to the natives?

No, but the natives were nice to the settlers.

Let's ignore all the unnecessary cruelty throughout all history and the present and assume that you are right. It doesn't matter, because people will be forced into these choices by competitive pressures even if their intentions are good. If your government tries to build a wonderful utopia for humans with the power of AI and robotics, it will be devoting a smaller fraction of GDP to producing robots that produce robots that produce war robots, so its robot army will be exponentially smaller than a different country that devotes a larger fraction.

The reason we have some nice things in the modern world, flawed though it is, is because for the last few centuries the military-industrial meta has favored countries which let people have some political and economic freedom. In a previous era, the meta was knights and peasants; a country without knights would be conquered, a country without peasants would starve, and a country that did not give the knights power over the peasants would lose a civil war. It doesn't matter what people want; technology will diffuse, someone will play the game to win, and any countries that choose less optimal choices will just be swept away.

This is all broadly covered in Sapiens. That book is great as it is unsettling. Its hard to deny.

in any case, how is one country/power with winning on their mind getting infinite manufacturing and raw resources to construct this robot army?

I find the book humankind to be more fact based AND have a positive outlook than sapiens.
> Once humans can be robustly replaced by machines, the military-industrial "meta build" will be a state with no humans, no cities, and 100% of all production dedicated to war.

We will nuke it long before it gets to that point. We don't nuke other countries because they still contain lots of humans. Any AI that actually becomes autonomous and starts to clear a nation state of cities and humans will immediately receive megatons in nukes.

Nukes are not magic wands, they are mostly only worth it for targeting cities and other very dense concentrations of value and production. An enemy state going down this path will probably start out with cities full of humans (and will probably want to "mine" those cities for materials), but its growing robot production will be more broadly distributed (and EMP shielded) and therefore much harder to destroy. And they will of course have their own nukes. I agree it's possible that a global nuclear war, if it starts early enough, ends with no one still having the ability to operate AI. But that's not exactly the most attractive way to shut it all down, is it?
Claude’s gonna code up some nukes?

Ok yes robot killer dogs from black mirror are terrifying and possible - they’re gonna enrich uranium from gpus and assemble nukes at the local toyota dealer?

what are we talking about

Governments, initially made of humans, will deliberately create military and industrial robots and assign them to create and scale production chains that go from natural resources to finished war machines. Maybe your government will not do this; in that case it will be helpless against the robot armies of those that do (yes, even if it has a few or few thousand nukes).
> … and assign them to create and scale production chains that go from natural resources to finished war machines…

so yes, you think claude’s gonna get a skill any day now to code up some nukes.

Your scenario assumes fully autonomous ASI. That’s just not what LLMs are. So then the discussion is more that ASI is inevitable. That’s much more interesting but very different from the point release of Opus.

'We' will not be players in this situation. Over the space of a few generations the only entities that will have any power will be the feudal corpo-state and the only entity that will have any power within that will be a thin crust of humans who control the central machinery of that corporation.

The rest of us will be irrelevant.

Even if it would be true (dubious), as long as those entities are controlled by humans, they will have a strong incentive to nuke any fully autonomous AI with obvious military objectives.
So sad. You're viewing humanity, and reality itself, through a very objective lens. There is magic in every day: have some fun! Otherwise, quit complaining.
‘Dont think, play pretend and be jolly’
No, think, play, and live! But not so in fear.
Fear is not usually a voluntary response. Telling people that they should not fear something (especially without an argument why there is no danger) is wasted effort.
You are going to be fed feet-first into a woodchipper, but don't worry about it just smoke some weed and chill out. Live, Laugh, Love that's what I always say