|
|
|
|
|
|
by wrath
3257 days ago
|
|
|
I don't think I'm being hypocritical. I have no issues if people crawl my site, I even identify who they are and give them access to a private API. I do not generate any income from that website though. I provide a service because I love doing it and I cover all the costs. Bots do increase my cost so I choose to limit their activity. Crawl me, but do so using my rules. One of the alternatives is charging for my service but bots are not my users problem, they are mine. |
|
|