| I think the really dangerous part here is not just “surveillance bad”. It is that AI removes the labour cost that used to limit surveillance. CCTV was already a problem, but someone still had to watch it, search it, interpret it, escalate it. AI changes that. It makes surveillance searchable, scalable and administratively useful. The shift is from “you may be observed” to “your behaviour can be continuously machine-interpreted”. That changes the moral shape of the state. A democracy can have police, courts, borders, audits, fraud detection, and public order. I don’t think the serious argument is that no one should ever be watched. The question is asymmetry. A free society cannot survive if ordinary citizens become more transparent to the state and its contractors than the state is to them. The principle should be: privacy for persons, transparency for power. Police bodycams should make police accountable. Procurement should be inspectable. Algorithmic decisions should have audit trails. Whistleblowers and journalists should be protected. Public systems should be legible to the public. What worries me is not only some cartoon version of Orwell. It is the boring version: safety dashboards, risk scores, fraud detection, productivity analytics, immigration enforcement, “trust and safety”, compliance automation, procurement contracts. The boot does not always arrive as a boot. Sometimes it arrives as infrastructure. And the hard question is not whether surveillance can create order. It obviously can. So can a prison. The question is whether it creates accountable power afterwards. A panopticon may produce “best behaviour”, but only by turning citizens into managed subjects. I have been trying to understand this fetish for controlling people through coercion that seems so prevalent in certain new modern business contexts, like amazon warehouse workers and delivery employees. The only thing it creates is resentment. Is that how you want to build a company or society on. Resentment? |
I think this misunderstands their goals. They don't care how society/a company is built. All they care about is that they are the one building it and that they are at the top of the hierarchy.
Just like with the startups and tech companies they built, they see speed as a critical advantage so that they can be the first-mover and establish a moat. Long-term viability and health is a distant secondary or even tertiary concern. If the panopticon and some weirdly neofeudal technofacist society can be built faster than something more egalitarian, then that neofeudal technofacist society is - from their perspective - better and that is what they will bias towards and build.