Hacker News new | ask | show | jobs
by tropin 5489 days ago
How do you know which is the oldest content? Are you polling web pages often enough that your spider can tell the time difference between the real content and the seconds old RSS scraped copy?

Just kidding, Blekko is great, althought I'm more of a DDG and Google user.

1 comments

Sites can feed new content to Googlebot before publishing to a broader audience. This is commonly done in Google News... you will sometimes click on a link to an article that claims to be not yet published. It is annoying usually, but helpful in this case.