Hacker News new | ask | show | jobs
by iurisilvio 3282 days ago
Are you using a custom domain? Robots.txt must be in your root folder, doesn't work with S3 urls.
1 comments

yeah its the S3 URLs that are causing the problem