When you think a bit better about it, it's about the same as regular web browsing. Just automated or scripted.
I don't think there is much that can be done to fully prevent it either, so.
Is this how youtube-dl was able to get out of the DMCA takedown? By saying that it's just acting on the links in the public HTML of YouTube?