|
|
|
|
|
by lbhdc
388 days ago
|
|
While that sounds fun, I think this misses that egress (typically) isn't free. Returning 403 and no content is cheaper. If a crawler is generating a lot of traffic dynamically generating content will make that crawl even more expensive for the operator. |
|