I believe o1's context window will increase over time as well. It's a new model that takes a different approach compared to other ones, so testing it with less context seems logical and expanding the context window as it's quality is validated.
Even in a large code-base, you don't have to have the full context of every single file for every single question, can usually get away with half a dozen files, it's figuring out which ones to provide to the LLM to get the best response.
Even in a large code-base, you don't have to have the full context of every single file for every single question, can usually get away with half a dozen files, it's figuring out which ones to provide to the LLM to get the best response.