Hacker News new | ask | show | jobs
by wayfwdmachine 1177 days ago
Yes. And it's fiction. We might as well discuss Excession, Agency, Diaspora (Banks, Gibson and Egan respectively) all of whom have more interesting and insightful things to say about humanity, game theory and ... seriously, as a life long (and I am OLD) science fiction fan, the fawning over The Remembrance of Earth's past is just silly. The concept of "suspicion". Might I suggest that people read Thomas Schelling's seminal work The Strategy of Conflict to begin with since if you want to understand concepts like brinksmanship and the push and pull of actual inter-civilization (or society or nation state) conflicts then you might want to start there and not with fiction riddled with silly concepts, weird misogyny and stuff that seems to be right out of the discarded parts of a Gregory Benford trilogy. I mean seriously.

But ok. Let's dig into this

"We can apply this concept of suspicion to the phenomenon in the field of modern artificial intelligence research. In AI research, some researchers believe that humans should pause the development of AI technology because of the potential unforeseeable risks it may bring."

An analogy would be that some of the scientists involved with the Manhattan project (see Szilárd petition) attempted to file an official protest against the use of nuclear weapons against civilian population and arguing that the weapons constructed were too dangerous to be a part of an arms race and should be placed under an international control body.

"However, another group of researchers believe that we should not stop because we cannot be certain whether those who are trying to catch up with us will use the advancement of AI technology as a hidden weapon."

Researchers are not decision makers in this or any other scenario. AI technology as a weapon? Sure but unless you are Bombs Away LeMay circa 1961 this really isn't a winnable or even useful use case. We're still in a blue sky phase. The fun thing about nuclear weapons is that if any nation feels that another is pulling too far ahead they can be used as a way to push for bi/multilateral discussions and eventually treaties limiting the production and/or deployment of weapons that risk of increasing tensions/lethality and so on . (see SALT I/II and START etc)

"This suspicion leads to a chain reaction, where people continue to worry about each other's motives and abilities, making it difficult for all parties to establish trust. Therefore, although there are good intentions, such proposals are unlikely to be implemented."

Again... read Schelling... this is just nonsense.

1 comments

"The only thing stupider than thinking something will happen because it is depicted in science fiction is thinking something will not happen because it is depicted in science fiction."

https://philosophybear.substack.com/p/position-statement-on-...