Hacker News new | ask | show | jobs
by suneilp 3905 days ago
Saying 50 concurrent agents is no big deal for most websites is kinda flippant. It all adds up and not every popular website can handle loads of traffic. By using a headless browser to gain a proper version of a webpage, you also strain a webserver with serving static files costing them bandwidth as well.