Hacker News new | ask | show | jobs
by KomoD 762 days ago
That's just for search engine crawlers, not random people who want to scrape all their data