Hacker News new | ask | show | jobs
LastPass edits robots.txt to make support articles difficult to find (bleepingcomputer.com)
3 points by tagersenim 1200 days ago
2 comments

From the article:

  All of today's support bulletins are not easy to find, with none of them listed in search engines, as the company added <meta name="robots" content="noindex"> HTML tags to the document to prevent them from being indexed by search engines.
The submission title includes "LastPass edits robots.txt" but https://support.lastpass.com/robots.txt doesn't seem to exclude those URLs and the article doesn't mention robots.txt
1) Presuming they're using a CMS perhaps it's an accident?

2) To clarify a bit, afaik, robots.txt is a request / suggestion, a nice to have if you will. It doesn't prevent indexing.