Hacker News new | ask | show | jobs
by DeepDuh 5096 days ago
Maybe their crawler identifies as IE7?
2 comments

Kogan's website isn't blocked for IE7, so I could not see how it can be a problem if the crawler identifies itself as IE7.
It is a problem if the site presents different content (that is, for example, the light box announcing the tax)

This may throw the search engines away, because you're "de-SEOing" your content

Never heard about crawlers changing their user agents. Never thought they can do that. Interessing idea.