Hacker News new | ask | show | jobs
by yuuuuuuuu 1087 days ago
How do residential proxies help? Scraping would effectively be bitcoin mining, which costs resources without shortcut.
1 comments

Many online services (including Twitter) do employ some kind of IP address scoring system as part of their anti-scraping effort.

These systems tend to treat residential proxies as normal users, and puts less restrictions on them. On the other hand, if the IP address belongs to some (untrusted) IDCs, then the system will enable more annoying restrictions (say rate limits etc) against it, making scraping less efficient.