Why is this terrifying? The prompt gave it the scenario and every detail; ChatGPT did exactly what it was told. If anything, this is less creative than the leaf example.
Actually, I'd suggest it didn't. The prompt implies (but without explicitly stating) that she is the passenger (maybe even one of several) in the helicopter. You wouldn't say "in which only she survives" if she was alone. But the response has her piloting it, with no mention of others on board. I think this illustrates how ChatGPT doesn't really understand the text it is manipulating.
A careful human that spends a good amount thinking of everything that is implied and how it should be put together is unlikely to make that mistake. But I'd argue the vast majority of people (if you sample all Americans for example, and that's a well developed nation) will do equally or worse with that prompt.
I'm not projecting my AGI dreams on ChatGPT. I'm being insanely impressed by what it does and continuing to see massive progress in that direction is thrilling, worrisome, interesting and so on. Nitpicking that it made a mistake in such a subtle assumption and handwaving away its understanding of things is disingenuous.
To be fair, I also didn't notice until the third time I read it. Call me inattentive maybe, but I at least understand the text. I just missed a single word
I employ a copywriter who can knock out 300 words on a range of subjects, to a very high standard, based on a similarly short prompt. I don't think she needs to worry just yet although I would suggest she doesn't think about upping her rates any time soon.
I've tried playing text adventure games with ChatGPT and it leans on certain tropes very heavily, especially if you don't give it a lot of "meat" to work with. It fills out scenes really well but if you don't give it strong direction and let it "drive" you get the text equivalent of unseasoned blended potato.
ChatGPT's response is good because this prompt has a lot of detail. You'd still need to hand hold it through the rest of this story if you want something interesting.