Nice one. Have you thought of stripping the text of words which do not contribute much to the meaning of a sentence? This way you could squeeze the context window even more.
I have written some stories myself, with the help of GPT, i will try to parse my stories with your method. It is very interesting.
As a side note, GPT is definitely not a toy. I use it for coding, it is great! I use it to write command line apps, which do some simple data manipulation, some more complex than others, but in the order of hundreds of lines of code. They work flawlessly, without me writing even a single line of code.
I have written some stories myself, with the help of GPT, i will try to parse my stories with your method. It is very interesting.
As a side note, GPT is definitely not a toy. I use it for coding, it is great! I use it to write command line apps, which do some simple data manipulation, some more complex than others, but in the order of hundreds of lines of code. They work flawlessly, without me writing even a single line of code.