Y
Hacker News
new
|
ask
|
show
|
jobs
by
nemothekid
4060 days ago
Facebook blocks all bots except a select few to prevent site scraping -
https://www.facebook.com/robots.txt