Hacker News new | ask | show | jobs
by dataflow 755 days ago
> My lane is this: I think we're producing new and powerful tools. Some of those tools can be used as weapons. Some of those tools seem to be footguns. But they're relatively broad tools that can be used for many purposes, and the idea that the toolmakers need special oversight because one day someone might figure out how to get the tool to produce a plan for a chemical weapon (Sec 3 (n)(1)(A)) seems misguided to me.

You do realize you're undermining your own point here? Photoshop isn't remotely similar to your description here...

But also, note that I'm not arguing this is a great bill. Again: I haven't had a chance to read it yet. Maybe it's terrible regardless. I'm just saying that if I take the (terse...) commentary I'm reading about it online at face value, they very much achieve the opposite of "convince the reader this is a terrible idea".

1 comments

AI in the specific form of generative models for images is not dissimilar to photoshop. My claim is that AI software more broadly is like a lot of other software, in that you can use it for a lot of things, a minority of which are bad. You know you can use excel to do accounting for drug trafficking businesses? And you can use google maps to plan your routes when trafficking humans? I don't think AI software is different in kind, only in degree, and if we accept that developers should be on a short leash because they might build something that can potentially be used for harm, then we should be aware that the creations of OS developers, language developers, web framework developers, P2P messaging developers, cryptography library developers, etc also are sometimes used by people doing bad things.

Your initial reaction, which I think comes off as snide and flippant, is that it's fine for AI developers face criminal penalties for building AI, presumably because it's capable of doing harmful things, even if those developers do not use them for harmful purposes. You don't seem to attempt any positive argument for why those developers in particular should be criminally liable, but developers of other broadly applicable tools should not.

In any case, perhaps it's all moot bc the person that was repeatedly downvoted to death was correct: I did look at the text and don't actually see criminal penalties anywhere. There are civil penalties though, and I don't think AI developers in particular should have to convince regulators that their work is 'safe' to avoid fines, but at least the stakes are lower.

However, some forms of generative AI are clearly harmful and should not be released to the general public. Take tools that can clone someone's voice with a few seconds of data. The legitimate use of such a tool is basically limited to special effects in a small number of movies / radio plays where the original speaker is dead or otherwise unable to be recorded again. However the developers have released these tools to the general public, and they are now being widely used primarily to scam people via grandparent scams and fake endorsements of scams by celebrities.

Personally, I think the people that released these tools should be held to account for the harm they are causing. I get that it was a cool thing to do, but the harm of their release is far, far greater than the benefit to humanity. As the developers of these tools clearly aren't considering the consequences of their release to the general public, there is a need for governments to step in and regulate.

Furthermore, this isn't a new phenomenon in the tech industry. The checks and balances that existed in advertising prior to online advertising taking over the world were irresponsibly discarded by companies like Google. Organizations like the various Advertising Standards bodies serve a purpose: to protect the public from harmful content, including scams. Instead we have a tech platform that has completely removed humans from the ad sales loop, which has resulted in ads for scams showing up higher in search results than the actual content. Combined with the decision to blur the visual differences between ads and legitimate search results, it is very difficult for less discerning individuals to avoid phising and other scam websites. I've seen this with my own eyes where my elderly father gets highly targeted ads online for scams that don't show up when I do the exact same search from the same local network.

Maybe computer scientists need to be required to take ethics and sociology courses to teach them why these things are bad.