“Google is wrapping knowledge up in answer cards and not sending traffic”

Y	Hacker News new \| ask \| show \| jobs

	“Google is wrapping knowledge up in answer cards and not sending traffic” (blog.sweetiq.com)
	4 points by landtco 4265 days ago

3 comments

Is there a generic list of defense techniques against scrapers, including but not limited to Google? E.g. move some content behind a login wall?

In theory, you can disallow crawlers and bots via robots.txt. It's not a hard defense per se because crawlers can ignore it.

Interesting, but the title is confusing. Better to use the original in this case.