|
|
|
|
|
by relistan
433 days ago
|
|
The point is to make it expensive to crawl your site. Anyone determined to do so is not blocked. But why would they be determined to do so for some random site? The value to the AI crawler likely does not match the cost to crawl it. It will just move on to another site. So the point is not to be faster than the bear. It’s to be faster than your fellow campers. |
|