Hacker News new | ask | show | jobs
by beej71 928 days ago
It was my naïve understanding that the training data no longer existed, having been absorbed in aggregate. (Like how a simple XOR neutral net can't reproduce its training data.) But a) I don't know how this stuff actually works, and b) apparently it does exist.

Has anyone figured out why asking it to repeat words forever makes the exploit work?

Also, I've gotten it into infinite loops before without asking. I wonder if that would eventually reveal anything.