| I think the issue is that those stories are rooted very much in the failures of human systems that we see every day. They are us imagining what could go wrong based on what has gone wrong and is going wrong. It would be a lot easier to set those warnings aside if we didn't have so many examples of the very things they warn about happening in real life. We currently have a system where private individuals can fund private science and then deploy the results globally to their own profit with very few mechanisms for enforcing restraint and caution. And we've seen this backfire with horrific consequences over and over again. Lead in the gasoline. Microplastics in the water. Pesticides widely applied to the biosphere. In my area PCBs are a massive risk due to past soil contamination. In other areas fracking biproducts make the water undrinkable. Hell the AI rush in the face of climate change. We literally have heatwaves killing massive numbers of people while a tiny handful of investors and the companies they control are drastically increasing our carbon emissions in the race for AI. It's easy to imagine all the ways in which synthetic life could go horribly wrong, even with out those sci-fi stories, especially since all but the youngest of us have been through a brutal pandemic in living memory. It's very, very hard to imagine our current system showing proper restraint with this technology. |
Ever since the industrial revolution, humanity has stumbled from one environmental disaster to the other.
Heavy metals, CFCs, acid rain, radioactive elements that don't occur naturally, microplastics, PFAS, large scale oil spills, greenhouse gasses, deforestation, over-fishing, species extinction, the list goes on & on.
And in each case, early warnings are ignored & the harmful activity is only curbed many decades after deployment at scale, when environmental harm becomes too serious to ignore.
Imho AI is no exception to this rule. Its energy usage alone adds to CO2 emissions at a time those should be reduced. Higher efficiency says anyone? No! Higher productivity. Read: same # of humans can consume even bigger amount of resources per time unit.
Yeah I can envision the wonders AGI/ASI could bring to humanity. But as deployed right now, it mostly helps to worsen a number of problems in human society (CO2 emissions, wealth inequality, concentration of economic/political power, to name a few).
Synthetic life? Absolutely, would be a fantastic scientific milestone. But could also turn into yet another eco disaster.