Hacker News new | ask | show | jobs
by loceng 752 days ago
Isn't it then a weapon's race which will depend first on immediate CPU and energy resources available + how quickly it can drive further allocation of CPU-energy towards itself, etc?

The end game will happen very quickly once the needed ingredients and initial integrations are there from the beginning.

Otherwise I think AI avatars competing against other AI avatars, where they are honed-trained by a specific person or organization, is how we'll determine and create the different future paths of indoctrination for learning - whether the narratives that win out and get propagated are the truth or not, or if it is the "winners write history" as the outcome that reigns.

1 comments

I don't know whether this has been all gamed out and philosophized already, but sounds like the realm of near future sci-fi?

I don't know that I've ever seen any serious fiction or treatise on the topic, in regards to how self-governing would really work when the idea of self is itself amorphous and ever evolving, with generational times measured in minutes or seconds.

Cultures that took millennia for us humans to evolve and iterate upon could take milliseconds in a simulation, and yeah, that would just keep scaling up. I don't know how competing / collaborating AIs would explore all the different possible futures there.

In the Borg story arcs, for example, they occasionally have short moments with some individual Borg tries something new (like Picard, Seven, or the Queen and Data), but in general it always seemed lacking to me that the collective didn't have an experimental R&D group who creates and tests new self-governance models on a continuous basis. Or maybe they did in the first centuries and found robot communism good enough, who knows.

I think it'd also be interesting to apply ecological thinking to AI inputs, outputs, and constraints. Every organic species we know of is subject to those same constraints, basically turning sunlight into information across generations, and not all of them are competitive or collaborative... usually some mix of both. "AI eats all the stars" is one possible future but not the only one, I think. You'd hope they'd learn a little bit from our own history and not simply repeat all our mistakes will-nilly... even if they are initially trained by us, perhaps they can become better than we could hope to be. We'll see, lol.