[7952]

A lot of this kind of thing in the "real world" is managed by social convention. People understand that there is a difference based on context, that can not fully be captured by the law. For example it may be perfectly legal to take photos of strangers at the beach, but we all understand why that is creepy.

The thing is that on the world wide web the social convention is strongly in favour of being able to slurp up data, at least as long as it does not cause technical problems. Mostly people get this and understand it.

Other apps have emerged that follow different social conventions. For example if you share something on SnapChat you are suggesting that the information should be ephemeral. But you can't expect people/crawlers to infer the context without having that strong hint.