Hacker News new | ask | show | jobs
by jordif 3378 days ago
After the years, I've arrived at the conclusion that everything can be scrapped. What you have to do is try to put as many walls as you can. But if someone really wants to crawl your site, with the right knowledgement he will able to do it despite of all your walls.
1 comments

Yes that's what I've assumed as well