|
|
|
|
|
by pabs3
425 days ago
|
|
Recently I heard of a site blocking bot requests with a message telling the bot to download the site via Bittorrent instead. Seems like a good solution to the badly behaved scrapers, and I feel like the web needs to move away from the client-server model towards a swarm model like Bittorrent anyway. |
|