Hacker News new | ask | show | jobs
by bbayer 3359 days ago
Thanks for the reply. Did you face any issues during crawling process like access restrictions. If you share your practice I will be appreciated.
1 comments

My crawler is modified from https://github.com/KopLyf/GPlayCrawler. Crawled 100k+ apps without any access issue.
I just tested this with `apt install python-scrapy python-pymongo && scrapy crawl google`. It seems to download one by one.

Edit: Interesting, it also downloads comments in my locale. Google play seems to be responding according to my IP information.