Hacker News new | ask | show | jobs
by chatmasta 826 days ago
This is nothing new. Google built an entire business on scraping and indexing content, and then aggressively blocks anyone from scraping that index.

If you think about it, it's kind of weird that there is no official API for Google search. They've got one for all their other products.

2 comments

The Google Search API was one of the first big Web 2.0 examples of an API. Basically every big colorful "how to do APIs" or "learn JavaScript" book in Barnes and Nobles used the Google Search API as their main example of what an API was and how useful it was until 2011 or so, when Google started turning it down.
Google: if your website is full of ads, we'll downrank you. >:(

Also Google: we automatically enabled vignette interstitials on your website. :)

Google: if your website is slow to load we'll downrank you

Also Google: builds tool that claims you load a bunch of JS & CSS from their ad network, thus making your own website slow

If you are fast to load we will present a slower amp link instead
Don't forget bloated Google Analytics and ad tracking garbage.