[ylere]

Hmm, that could be. It happens with different prompts when the number of input tokens is over a certain length.

Fascinating how hard these kind of issues are to debug.

[throwawayadvsec]

If it's about the length it maybe due to optimizations for the large context length