|
|
|
|
|
|
by marginalia_nu
1466 days ago
|
|
|
CloudFlare isn't that bad in my experience. They were really aggressively blocking me when I started out, but there are some hoops[1] you can jump through to make them recognize your bot. Goes a long way. It does depend on the sites' settings though. Some are set to block all bots, and then you're kinda out of luck. In general, I've found that like 99% of the problems you might encounter running a bot can be solved by just finding the right person and sending them an email explaining your situation. In almost all cases, they'll let you through. [1] https://blog.cloudflare.com/friendly-bots/ |
|
|