Hacker News new | ask | show | jobs
by boznz 408 days ago
It is all about accuracy for me, as a reader, reading a book needs you to be able to forget about everything and be immersed in the world and the characters you are reading about, a simple mistake like the wrong name being used, a date being slightly wrong, or a him/her mistake can yank you out of that and really annoy you. For serious readers it does have to be 100% accuracy, 99.99% is not good enough.

A few weeks ago as a test, I copied the whole of the last draft of my last novel into two AI's and asked them to find mistakes, unanswered questions, continuity errors, plot holes etc. They found no genuine ones and lots of false ones, even after some serious prompting. The two test readers I used found five between them which would have been very embarrassing if they got through to publication.

1 comments

I definitely agree.

Luckily, some things are easier for the AI to remember. I've never once come across the AI making mistakes with things like wrong character name/pronouns/etc.

The main consistency issues I've seen come from remembering the past plot, and worldbuilding.

The past plot issues come from having to store past scenes concisely. Right now, this means I can't include more than 40 of the past scene summaries. But I'm actively thinking of ways to improve this. (Note: I've found that after the input prompt surpasses a certain length, the output quality starts to degrade).

The worldbuilding issues stem from a couple things. I currently don't have any worldbuilding tracking implemented. I did in the past, but it wasn't as intuitive as storing something like character data. If I included data for locations, for example, it seemed to either not follow it at all, or it would be arbitrarily limited by it. I'll get to fixing this once I improve a few other features. In my experience, the lack of worldbuilding hasn't necessarily hindered the stories too much. Brandon Sanderson once said that out of plot, character, and setting, setting was by far the least important. I definitely agree. Though having good worldbuilding will improve the story.