I am looking for tool or search engine for technical web crawler results. I want to know what sites are using certain products and/or plugins. I have seen nerdydata.com but I am looking for other options.
That sounds promising, can they run a custom report across their entire index? I'm trying to get a count of competing products to gauge market size and interest.
They gave us the option of either running a report on their entire index, OR if we had a list of domains to search explicitly (which we didn't have).
Our use case was different, though, we wanted to find websites using a javascript library, and then run a javascript function on all of those sites to extract account information and specific html patterns.
But yes, their larger custom reports index did the trick, would recommend.
Our product is very simple:
a) Scrap ads b) Display ads c) Sell subscription to customers.
Advertisers pay to spy on competitors' ad, surprisingly it's quite easy to build if you know how to scrap and implement a search on top of it.
Scraping costs $10 per customer and we sell it to customers for $159 per month.