|
|
|
|
|
by chii
3245 days ago
|
|
if a human is allowed to do something on a site, it goes to reason that a bot should be allowed too (granted using the same access frequency as a human). Blocking scraping is like DRM. Don't do it. Use a legal mechanism to deal with copyright infringement, and use acceptable usage policy to deal with heavy users that are using more than their "fair" share of bandwidth. |
|