[gersh]

I think they can just tell the zip code where you use the card.

[JshWright]

Right, they know where the transaction is taking place. The point is that they can have much higher confidence that the card hasn't been stolen (or cloned, in the case of mag stripes) if your phone is also in the same zip code.