[joshribakoff]

> We exclusively use 1M internally, so we're dogfooding it all day

That is so out of touch. Customers do not exclusively use 1M. This is like a fronted developer shipping tons of unused Mb and being oblivious because they are on fast internet themselves.

[sumedh]

They should ideally have automated tests with the option models and smaller context window to check there are no regressions.