[ghaff]

538 has actually written about calibrating past forecasts. https://projects.fivethirtyeight.com/checking-our-work/

[throwaway2245]

Their calibration is good in the context of this article, but there is a reason this article doesn't use their Presidential election model - there isn't enough data to do this calibration here.