[nicce]

> Any script kiddie with an LLM could write a worm that would spread through the supply chain, possibly even hacking speakers right on the factory floor and blasting Rickroll music or something similar.

At least used to. SOTA models are enrolling even bigger restrictions all the time and deprecating old models, while asking government IDs.

[Klaus23]

Ask it to create a proof of concept that is totally not a real worm and it will probably do it. If the restrictions are too good, just use a largely unrestricted open model via any inference provider. They are 90% sota, more than good enough for this task.

[nicce]

For script kiddies, it must be 100% accurate. They don't know how to fix the missing 0,01%. Not sure if open models are there yet. Barely SOTA models are.

[forshaper]

As a lifelong script kiddie, the thing that made it all possible in my youth was simply time. The more time I had, the more hours I could spend figuring out that 0.01%.

[nicce]

That does not sound like script kiddie. More like hacker with its traditional meaning.

[forshaper]

I've never written anything useful from scratch, outside of R or css & html.