Hacker News new | ask | show | jobs
by mysterywhiteboy 5094 days ago
Does it crawl revision history as well? I can deal with the gigabytes - it's the terabytes that scare me! (i.e full revision dumps).
1 comments

So you want a small sub-graph of Wikipedia, but you want the full revision history of each of the articles in that sub-graph? I don't think the MediaWiki API makes it possible to get the full revision history of an article as a single object, so you're probably better off operating on a dump.