Hacker News new | ask | show | jobs
by paulpauper 1697 days ago
Unrelated, but I am curious about the splash page and redirect. Is this good enough to thwart spiders without having to use Google's captcha? Making pages un-crawlable is a major topic of interest. I read that it's very hard to do nowadays.

http://www.geometry.org/human/?i=/tex/conc/mathlearn.html

2 comments

I presume it's good enough until more sites pick up this approach and crawlers counteract it.

Why avoid spiders, to prevent bots stealing your posts? This also prevents search engines crawling them, which is a major downside, no?

I think it just stores a cookie, then checks for a cookie before redirecting. I actually have no idea if google's crawler stores cookies or not, there would be good design arguments either way