[lelandfe]

Yeah, I just got ChatGPT to give me a recipe for chlorine gas that looks pretty accurate (per Googling, not a chemist). It took probably 10 seconds of prompt tweaking. A subsequent prompt gave me steps for purchase or synthesis of each material. I asked it for mustard gas, but the procedure looks very incorrect from Googling.

[flangola7]

GPT-4 will almost always give accurate instructions but it is much much harder to jailbreak.

[lelandfe]

Just jailbroke GPT-4 to provide a similar answer for both. The answers overall look quite a bit better.