[lewhoo]

My understanding is all of the issues on SWE-bench have at least a corresponding pull request.

[skywhopper]

The important detail is when the problem was solved. If it was three years ago, then it was likely captured in the training data for the model.