The point is to combine something you know with something you own. The thing which you own can contain your passwords too.