Hacker News new | ask | show | jobs
by AshArchangel 2220 days ago
Hello, I do some webscraping at my job using python, but I've found that scraping social media for non-specific data is often the same amount of work as manual searching or using google search tools like "site:". With that said, and similar to anigbrowl's comment, without a specific goal in mind you will be hard pressed to solve your problem. Social media scraping varies heavily by platform in terms of what information is available to scrape (without brute force).

If you want some social media OSINT tools that are already built in python, Black Arch has a list of open-source tools that you can access and use:

https://blackarch.org/social.html

If you are trying to identify someone's social media, Sherlock or Spiderfoot are commonly cited, but again, I don't think that these tools save that much as opposed to just using Google's search logic efficiently.

https://github.com/sherlock-project/sherlock