[mountainriver]

It’s legal but if you don’t consent to people doing it in your robots.txt you can sue them civilly