Hacker News new | ask | show | jobs
by RockRobotRock 1043 days ago
It's tough when there's a cat and mouse game to spoof your UA so you don't get blocked. I wish webmasters had better relationships with scrapers and could accept the realities that your data will be scraped no matter how much you try and stop it.
1 comments

IMO, We should really just get rid of the user agent header altogether.