| For example, some black hats trained LLMs to pentest, so to find more easily vulnerabilities. Those can be used either to improve your defenses or attack entities. The AIs like Copilot et al are trained on code poorly written with bad security practices (there is a lot more than you think), hence reproducing these bad practices on produced code. Because also AI are fallible, the spreading of misinformation more than we already have.
The retrieval of credentials with prompt hacking, because people push their credentials. Because they are generated by AI, the misuse of deepfakes, for example a spanish girl was blackmailed with alleged naked pictures of her, but could be used for far worse. And I did not scratch the copyright/artistic side of AI. It's not the AI per se the risk, but what people can do with it. Everything is not beautiful. But there are also good things with AI, I agree. I think there is the need for some form of regulation in a way or another, the sooner the better. I don't expect the regulation to restrain creativity, but to help prevent bad stuff happening. |