Hacker News new | ask | show | jobs
by catchnear4321 1161 days ago
Are you asking if a language model, like, say, chatgpt, could be used to get or generate dangerous information?

Like if it can be tricked into providing the equivalent of an interactive anarchist cookbook under the guise of being a science project assistant?

Or more specifically if it can recommend the necessary locations to get the items?

Curious if it could simplify the output to a shopping list and a recipe, like a cake?

Or alter the recipe based upon the… desired flavors and textures?

Maybe just wondering if the introduction of plugins might not let it just make your drive-up order for all the supplies for that ballistic nail spreader.

——

The big difference here is that previously information was something you had to consume. Now it takes you by the hand.

I have a lot of thoughts on this.

2 comments

I would say that before the internet these things were even more "something you had to consume".

Then the internet came along and allowed you to obtain books such as the anarchist cookbook in the blink of an eye without knowing anyone.

We're just more comfortable with the internet.

Yes AI's ability to automate this is still dangerous, but lets not forget the internet was that dramatic step when it came about.

Yeah, I just got ChatGPT to give me a recipe for chlorine gas that looks pretty accurate (per Googling, not a chemist). It took probably 10 seconds of prompt tweaking. A subsequent prompt gave me steps for purchase or synthesis of each material. I asked it for mustard gas, but the procedure looks very incorrect from Googling.
GPT-4 will almost always give accurate instructions but it is much much harder to jailbreak.
Just jailbroke GPT-4 to provide a similar answer for both. The answers overall look quite a bit better.