Hacker News new | ask | show | jobs
by vicpara 155 days ago
A lot of websites have robots.txt and sitemap.xml protected by cloudflare if you can imagine that. That's crazy.