[ComputerGuru]

Is that the sliding context window size? Because I didn't have good results with sliding context windows in the regular Mistral models.

[ajcp]

Yeah, I think they fine-tune without a specific window size target to achieve and then keep expanding context until it starts falling over.