Hacker News new | ask | show | jobs
by abraham 5143 days ago
What are you talking about? The only aspect of Blogger that is robot restricted are the search pages (as they should be).

http://googleblog.blogspot.com/robots.txt

1 comments

Talking about this

http://support.google.com/websearch/bin/answer.py?hl=en&...

There other ways of blocking crawlers other than robots.txt