This drove me nuts until I found block select. (Option-Command drag in OSX). That pretty much eliminated that problem for me.