Hacker News new | ask | show | jobs
by throwawaywhynot 2762 days ago
they should if it's even possible. They knowingly allow web crawlers to index their sites