Hacker News new | ask | show | jobs
by esha_manideep 730 days ago
They check after they scrape
2 comments

How? Real people read all millions of pages of internet texts to verify it?
Looks like it’s just scrambling each individual word. Seems straightforward to programmatically look for groups of things that aren’t legitimate words on a page.
That's a lot of time and bandwidth to waste