Hacker News new | ask | show | jobs
by saturday14 2267 days ago
Is this based on Google Trends? Where is the data coming from?

Interesting project, btw

1 comments

Our data relies on Google and it is based on what consumers are searching for.

Specifically, it relies on Google Trends, Google News, Google searches, Amazon searches, Twitter searches and YouTube searches (for now!)

We also have a partner for e-commerce data (usecart.com)

Very cool. I guess as you grow, you could get more partners and the data will keep getting more and more accurate. I wish big guys like Amazon released aggregated sales data.

How do you get access to Amazon searches, google searches etc? do you have to pay for those?

Absolutely. I don't pay to access data. All of my projects are around collecting data. I'm a master scraper ️

If you are curious, at https://rubini.solutions you can check out my other SaaS products =)

Just checked your list of products, very cool!

I've always wondered about building a career with scraping, but never got around to it. One reason is the legality of scraping - big sites like Craigslist have gone after (and shut down) smaller projects. I believe priceonomics (YC company) built a big business with scraping.

And how do you scrap Google data? They don't ban you or ask to enter "I am not robot" captcha?
No, as I mentioned, I'm a master scraper.
Are you not breaking their ToS though?
Nope, everything is ok