[rmbyrro]

Sure, that's why I said "superficially looking", because the back of my head said you obviously have a conscious intention consistent overall.

Would you mind elaborating more on where you draw the line between "good" and "bad" behavior when it comes to scraping?

Is it obeying robots.txt, the monetary purposes (profit / non-profit)?..

I personally have a hard time accepting that a website can allow Google to scrape all their content, but prevent others. In my view, this is anti-competitive behavior favoring a large and evil corporation. Argumenting that Google delivers value back in the form of traffic is unacceptable to me, because it goes against basic principles of net neutrality, which I support.

I'm intetested in reading your thoughts on this.

[cookiengineer]

I wanted to reply here, and actually posted the comment but then deleted it because some 4chan folks were already starting to comment here again.

I wrote you an email, would love to discuss this further.

[rmbyrro]

Sure thing, I see weird things here sometimes.. Haven't got your email. You can send to my username at gmail.