Hacker News new | ask | show | jobs
by londons_explore 2350 days ago
Give a few examples of it.

Theres a good chance whatever page you were after had a robots.txt excluding googlebot.