Hacker News new | ask | show | jobs
by bake 3298 days ago
Indeed. If you're looking for programmatic web search, I'd suggest you go the Bing API route.
1 comments
charred_toast 3298 days ago
I commented earlier on this post about it being impossible for a bot to do search on Google. Turns out I turned to the same resource you're recommending. I'd also recommend sending a python bot to your favorite news sites once a day for updates instead. Same deal, Beautiful Soup. On the other hand, Google has Custom Search, which is $100 a year for 20k queries. I use that as well.
link
bottled_poe 3298 days ago
Google CSE seems like the most fitting solution, which appears to do pretty much the same thing as the article, but without all the hackery nonsense:

Step 1 - Setup a CSE to search entire web: https://support.google.com/customsearch/answer/2631040?hl=en

Step 2 - Use the CSE API: https://developers.google.com/custom-search/json-api/v1/over...

link
defenestration 3298 days ago
It looks like Google is shutting down the paid version of Custom Search Engine: "On April 1st, 2017, Google will discontinue the sales of Google Site Search, the paid version of Custom Search Engine. All new purchases and renewals must take place before this date. This product will be completely shut down by April 1st, 2018." Source: https://cse.google.com/cse/
link
surfingdino 3298 days ago
If you want news, use RSS. Almost every news site is using it.
link