There are other ways to avoid double-spends, too, like taking the party to court.
Mining does not need to be incentivizes nearly as much as it is right now for bitcoin to still function as p2p cash.