[ShamelessC]

> I feel like this just killed a few small startups who were trying to offer more context.

Those startups killed themselves. A 32K context was advertised as a feature to be rolled out the same day GPT-4 came out.

Also - what startups are getting even remotely close to 32K context at GPT-4’s parameter count? All I’ve seen is attempts to use KNN over a database to artificially improve long term recall.