[nurple]

Presenting it with an alter-ego is a common method of "jailbreaking" GPT. I think one of the early jailbreaks was named Dan.

ETA: https://gist.github.com/coolaj86/6f4f7b30129b0251f61fa7baaa8...