Hacker News new | ask | show | jobs
by snowwrestler 1041 days ago
Yes, of course, but that analysis happens after the content has been visited by the bot. It’s still a visit, and still hits the “crawl budget.”