Hacker News new | ask | show | jobs
by dwyer 4736 days ago
Yelp is very aggressive against crawlers. They IP banned me for curl'ing their site a few times for something or another that their API didn't provide. I had to email them and promise never to do it again. I'd imagine it has provoked some to attempt to crawl them via Tor. I just use the Open Table API instead.
1 comments

! Cheers to the tip.