Hacker News new | ask | show | jobs
by MattGaiser 486 days ago
I have experience with a tiny part of this problem; accessing the various websites and figuring out where to click.

Presently, doing this requires a fair bit of continuous work.

Many websites don't want bots on them and are actively using countermeasures that would block operators in the same way they block scrapers. There is a ton of stuff a website can do to break those bots and they do it. Some even feed back "phantom" data to make the process less reliable.

There are a lot of businesses out there where the business model breaks if someone else can see the whole board.

1 comments

Good point, raises a very interesting question: if the big websites block agents, won't agents be extremely limited? Should big websites 'charge' agents?