Hacker News new | ask | show | jobs
by karim 3408 days ago
Hey Jim – thanks for doing that! I'm curious, how did you back up IMDB's message boards? Did you scrape the whole website or were you able to find a data dump?
1 comments

I wanted to ask this too. Did you scrape it or did it via some api? Anyway, cool project, wish you all the best with it.
illegally scraped,IMDb doesn't have API for this and automated scraping OP done is against their TOS, not mentioning without consent of users, for instance stole 14 years worth of my posts
He stole them? You mean they are gone now? Because the closest I can imagine happening is an unlicensed reproduction of your content, your credentials included. ... Like any archive service would do it.
I take it then, when you posted these 14 years of comments, you didn't want them available to the public to, I don't know, read?! Thank goodness IMDB deleted them all before we happened across them by accident & violated your privacy.