Windows Vista did something similar to support both panning and selecting with touch screens.*
A vertical drag would pan the content, and a horizontal drag would act like a mouse: select or drag-drop the content.
http://youtu.be/roP3YtLvblE?t=2m22s
I thought it worked well, even though it made horizontal scrolling harder (had to use 2 fingers).