|
|
|
|
|
|
by 013a
3202 days ago
|
|
|
They might be using it as a way to find specific pages which have content Yelp doesn't want you to scrape. The "evil" scenario. They might also not be looking at the file, and just appending random words to the end of Yelp's biz URLs to scrape every business. Which, at some point, it might hit that URL by accident, since they are all words you'd find in other business URLs. Though this seems less likely. |
|
|