I find myself using the term “human superorganism” a lot these days. Our bodies are composed of many cells and microbes working together; and if we zoom out, we have the dynamics in which human individuals operate together as superorganisms. IMO there’s a whole world of productive thinking to be done to attend to the health and strength of these entities.
Thatcher was briefly a research chemist; it’s extra weird that she couldn’t see beyond the atomic unit, to the societal equivalents of complex organic compounds.
A single person acting in isolation (no friends, no colleagues, no customers) has very little agency. While theoretically a single person could release smallpox back into civilization, we have collectively selected it out very effectively.
The question is only relevant if AI is a significant force amplifier. If it is not, it is an unthreatening tool, whose usage should be largely unrestricted, this is the case now.
If that ever changes then there is the question what to do with it and at a certain level of power an individual decision would have impact, if sufficiently amplified.
It doesn't, by default. All it takes is a capable enough model without rails, and a single user instructing it to act autonomously as its primary goal.
The point is, AI is not able to act capably or autonomously. If someone tells it to "act autonomously" it'll either sit like a lump or flail until the power runs out.
All it takes for somebody to nuke Atlanta is an atom bomb and an airplane and somebody willing to fly the plane.
I’m being facetious but there ARE ways to decide/act as a society and as subgroups within society that we want to disallow and punish and select out qualities of AIs that we think are unethical.