Hacker News new | ask | show | jobs
by photochemsyn 1166 days ago
As usual with groundbreaking technology, reckless use by military/intelligence agencies are the greatest consequential threat. If we rank unbounded AI on the same potential threat level as nuclear, chemical and biological warfare, than history says that's who will be the first to utilize it in the worst ways possible.

I do notice the federal government is going all-in on AI contracts at present, here's the non-black-budget sector and contracts on offer:

https://federalnewsnetwork.com/contracting/2023/02/dod-build...

I'll bet some eager beaver at the NSA is just dying to get the latest GPT version setup without any of the safeguards and run their whole collection of malware/hacking software through it to see what it comes up with. The fact that nobody's talking about this means it's probably in full swing as we speak. What that means is that smaller groups within the government will be able to cook things like Stuxnet2.0 up without hiring a hundred developers to do so. If we start seeing AI-generated malware viruses in the wild, that'll almost certainly be the source.

On the other hand, we should also be seeing publicly-accessible AI-assisted security improvements as well, leading to a scenario oddly similar to William Gibson's Neuromancer / Sprawl world, where AI systems build the malware as well as the defenses against malware. That's a pretty solid argument for continued public access to these tools, on top of the incredible educational potentials.

1 comments

> The fact that nobody's talking about this means it's probably in full swing as we speak

There are people talking about it obviously.

> That's a pretty solid argument for continued public access to these tools, on top of the incredible educational potentials.

We have millions of books yet many people haven't even read the Bible they nominally base their uneducated life on. :|