Technical curiosity---if I use such a client, and two block chains disagree (on, say, some history that affects the current operation), then won't I end up choosing and sticking one?
Yep! At that point, the problem isn't a blockchain-specific one, it's a more general problem of reconciling conflicting truths. A common, trivial solution is to rank sources of truth.