[diedyesterday]

> "Is it really possible that this space is so rich as to have a single point in it encapsulate a whole novel?"

Not with this GPT. The context size would not allow keeping attention to the total meaning of more than 2048 tokens (as reflected in the transformed embedding of that context's last token). For a substantial part of a novel, it would require a much larger context size with then presumably will need a higher dimensional embedding/semantic space.