[aiappreciator]

That's because you used ChatGPT. Rather than GPT-4. GPT-4 has more parameters, so can remember much more obscure facts.

I had GPT-4 analyze the ethics of some obscure japanese visual novel from the perspective of multiple characters in that story. It did so flawlessly.

ChatGPT would have started making up stuff in the second paragraph because it couldn't remember what actually happened.

[pms]

Have you provided the visual novel as a prompt or just asked about it? ChatGPT does seem to know more about books than songs, maybe because they are more often described in texts, while songs not, not sure.

I wished more parameters gave a generalizable solution, but research suggests that's not the case [1, 2, 3]. OpenAI won't tell you this, cause they have a product to sell.

[1] http://arxiv.org/abs/2211.08411 [2] http://arxiv.org/abs/2011.03395 [3] http://arxiv.org/abs/2005.04345