Hacker News new | ask | show | jobs
by iamnnk 658 days ago
I want to scrape all possible items of a post: video or photo when that's there, the caption, the hashtags, location tag.

If all aren't possible, which are? Want to let my users derive searchable intelligence off this info - intent is commercial.

1 comments

I'm not a professional but it's depends too the social media (like scrapping Instagram it's not the same to scrapping X). Also social media fighting Instagram (blocking if to many requests are made) and they change their HTML tags. But like I said I'm not a professional in scrapping and I can make some mistakes.