Hacker News new | ask | show | jobs
by andrewstuart2 4050 days ago
To my knowledge: Google requires that you can't serve different content to its bots than a user can reach from the search results. So the link from a Google search changes the Referrer to Google (since it's a redirect) and WSJ gives you the content.