Hacker News new | ask | show | jobs
by Goofy_Coyote 196 days ago
Question: If I do a search for say crypto on your blog, how does Google gets to index the resulting page?

I’m imagining something like “blog.example/?s=crypto” which only I should see, not Google.

Edit: Where they linking to your website from their own? (In that case the link with the bad search keywords can be crawled)

2 comments

They are spamming other websites with links to my website like in your example. Google crawl those other websites, follow the spammy link to mine, and I get penalized for having a page with spam content.

The solution is to tell the crawler that my search page shouldn't be indexed. This can be done with the robots meta tags.

I see, thanks for helping me understand the issue (and also the solution)
Link.com?search=spam from external page