[scottlegrand2]

We certainly tend to fall into scripts and follow those scripts for many things in life. GPT-2 demonstrated how much online prose is glorified mad libbing IMO and yet it has no sense of a consistent long-term context nor do its articles make any sort of significant point. Reading its output is impressive but it reminds me of what I hear from someone with dementia.

that said I think if you made its context recurrent in some way between responses and queries you could probably build a really interesting chatbot that could ramble about just about anything and nothing but do so in a sufficiently coherent way to scare up venture capital. Just a guess but it is my guess.