[levihanlen]

Hi HN,

I'm Levi Hanlen, the developer behind Varu AI: https://www.varu.us

Like many writers and readers, I had far more story ideas than time to write them all, and frankly, some stories I just wanted to read that didn't exist yet. I started building Varu AI to explore if AI could help draft these complex, long-form narratives in a more collaborative way.

Varu AI works scene-by-scene. It doesn't outline beforehand (apart from the scene outline right before each scene). The core idea is interactive guidance using what I call 'plot promises' – inspired by Brandon Sanderson's writing lectures on narrative structure. You define key plot points or character goals, and the AI works to fulfill them. If you don't like the direction, you can adjust these promises mid-stream to actively steer the story.

As a test case (which I wrote about recently), I used it to generate a 59,000-word sci-fi first draft in about 30 minutes of interaction. I'm also having it write me a 300,000 word novel (you can find this one on the website, called "Under Falling Banners". Currently still reading/generating it)

The biggest technical challenges are definitely maintaining long-range consistency of plot and managing the LLM context window effectively, while also being cost-effective. I've found that longer input prompts degrade the quality of the output. So I can't just stick in the last 50,000 words and call it a day (at least not yet). Currently, Varu AI uses techniques like dynamic scene summaries, but improving this is an ongoing effort.

It's still relatively early days – it's a public Beta. The output quality varies and absolutely produces a first draft requiring significant human editing and rewriting, not a finished, polished novel. But I'm actively innovating on the underlying systems, and I'm really excited for the future of Varu.

It's built with Next.js, TypeScript, Tailwind, Prisma, Postgres, and Stripe. Hosted on Vercel.

I'd love to get feedback from the HN community, especially from developers, writers, or anyone interested in the intersection of AI and creativity. Happy to answer any questions about the tech, the process, the challenges, or the philosophy behind it.

On that note, I'm particularly curious if others tackling long-context generation have found effective techniques beyond summarization that balance cost, speed, and quality well?

[boznz]

It is all about accuracy for me, as a reader, reading a book needs you to be able to forget about everything and be immersed in the world and the characters you are reading about, a simple mistake like the wrong name being used, a date being slightly wrong, or a him/her mistake can yank you out of that and really annoy you. For serious readers it does have to be 100% accuracy, 99.99% is not good enough.

A few weeks ago as a test, I copied the whole of the last draft of my last novel into two AI's and asked them to find mistakes, unanswered questions, continuity errors, plot holes etc. They found no genuine ones and lots of false ones, even after some serious prompting. The two test readers I used found five between them which would have been very embarrassing if they got through to publication.

[levihanlen]

I definitely agree.

Luckily, some things are easier for the AI to remember. I've never once come across the AI making mistakes with things like wrong character name/pronouns/etc.

The main consistency issues I've seen come from remembering the past plot, and worldbuilding.

The past plot issues come from having to store past scenes concisely. Right now, this means I can't include more than 40 of the past scene summaries. But I'm actively thinking of ways to improve this. (Note: I've found that after the input prompt surpasses a certain length, the output quality starts to degrade).

The worldbuilding issues stem from a couple things. I currently don't have any worldbuilding tracking implemented. I did in the past, but it wasn't as intuitive as storing something like character data. If I included data for locations, for example, it seemed to either not follow it at all, or it would be arbitrarily limited by it. I'll get to fixing this once I improve a few other features. In my experience, the lack of worldbuilding hasn't necessarily hindered the stories too much. Brandon Sanderson once said that out of plot, character, and setting, setting was by far the least important. I definitely agree. Though having good worldbuilding will improve the story.