|
|
|
|
|
by catwind7
2201 days ago
|
|
I actually did notice that issue, even with using a stateful client like mechanize. Sometimes I had to scrape > 5 times in order to get through the "anti robot" page. Other times, I get no issue at all. It's weird - maybe they're doing some pattern matching on request metadata on their end? |
|