One step at a time! Next it'll be defensive technology only, then defensive weapons, then the best defence is a good offence. Before you know it, it'll be "wipe out the humans to achieve peace in our time."
In theory all our weapons are defensive. Hence the name "Defense Department". We will know to start worrying when GPTChat starts chatting about protecting its 'precious bodily fluids';)
One step at a time! Next it'll be defensive technology only, then defensive weapons, then the best defence is a good offence.
LLM chatbots pose no existential risk, because they are not autonomous. However, give a model an OODA loop and planning, and it could become an existential threat.
The problem with military applications, is that having an OODA loop which is potent enough to defeat a human being is basically required. Once multiple factions have such AIs, then those AIs will be in a mutual arms race and become ever more potent. Planning capabilities will also improve in such an arms race.
Before you know it, it'll be "wipe out the humans to achieve peace in our time."
If the AI arms race is very rapid and the improvement curve is steep enough, then humans might become as irrelevant as black powder arms on the modern battlefield. (And everywhere else)
Preposterous, sir! I have it on good authority from the marriage equality bros that slippery slopes are just fear-mongering. Why would schoolteachers all of a sudden be transing kids just because some tiny, tiny proportion of adults are getting visiting rights at hospitals? Moore's Law--also slippery slopism. As if computers will magically get faster next year just because they did the last n years!
Actually black Americans tend to vote strongly against child genital mutilation. If you had only listened to black voters (of California Prop 8 fame), the civil rights struggle of our time would almost certainly not be sterilizing people who because of their youth we do not allow to ride a bicycle without a helmet.