[epolanski]

Quality degrades fast with context length for all models.

If you want quality you still have to compact or start new contextes often.