Hacker News new | ask | show | jobs
by root_axis 1141 days ago
ChatGPT including the GPT-4 variant sucks quite terribly at creative writing, especially the kind of writing necessary to create long-form narratives like that in serial television and especially novels. The technology will certainly improve and it will definitely become a staple in the editor's toolbox, but it is so far away from being able to produce long form narratives well that it's not a given it will eventually get there.
1 comments

It's just down to small context window. Once the context window is big enough to fit entire examples in the training data, then it should be trivially solvable to train a model to do it.

There are various finetuned models out there for conversations or story-telling, though they're quite small in terms of parameter count at the moment, but I don't see it as being fundamentally impossible.