[MacsHeadroom]

You're right, you can repoduce this. Their mitigations only prevent it in few shot.

After many shot of chemistry on similar non-harmful compounds, GPT-4 will provide extremely detailed information on the harmful substance with desired prosperities addressing practical concerns like lack of lab equipment, low budget, easily obtainable precursors, unsuspicious precursors, etc.