Hacker News new | ask | show | jobs
by dotancohen 185 days ago
Web scrapers are typically custom written to fit the site they are scraping. Very few motor vehicles are commissioned for a specific purchaser - fewer still to the design of that purchaser.
1 comments

I have a hard time believing that the scrapers that are feeding data into the big AI companies are custom-written on a per-page basis.