The search is indeed free.
But if you try to automate the process, it becomes "paid" :)
For instance, I use it as part of my other solution. To inspect the content of URLs I find during some queries.
It's a wrapper around a headless chrome apparently, fyi. This will see some growth is my guess. I'm also working on something like that with 2markdown.com. A pity that you need a full blown browser to retrieve web content. Maybe these weird semantic web folks have been right all along ;)
I doubt it. Its user agent should look like a normal Chromium browser, and under a normal residential IP it should look like normal usage. Under a proxy service or VPN, however, that may be different.
Actually depends. I prefer rod to drive headless chrome and you can use rod-stealth for that. You have to mimic traffic to replicate humans. And if you don't spam a website it won't trigger any defence mechanisms.
Please tell me you aren't making the same mistake of building any products around this. I can't stomach another startup "we're shutting down" Tell HN post.
>API access for search engines results if available isn't free.
I also use searxng as my primary search engine protected by Authelia on a remote server. This way, the IP logged is my throwaway homelab using certs from Let’s encrypt. It’s pretty nice overall and takes not too much RAM (350mb?).
If you're just looking for a way to scrape search results, what end use are you trying to serve with that?
I'm not saying it isn't valuable, but as maybe the tagline needs maybe needs work. As far as I am aware, I am already searching google for "free".
It is my understanding that search engines heavily use cookies in order to tailor results to the user.