[brandonb]

In the paper, they say they used the most recent 56 cases (from 2024–2025) as a holdout set. The majority of those cases happened after the o4 training cutoff of May 31, 2024.

[miraculixx]

Are these 56 cases distinct from all other cases in the data?

[FlyingLawnmower]

Yes. They are about entirely different patient reports.