If we are only surveying a portion of the sky at a time and a faster asteroid spends less time traversing that portion, the likelihood of detection is lower.