Hacker News new | ask | show | jobs
by gyaru 426 days ago
yep, I'm running a pretty sizeable game Wiki and it's being scraped to hell with very specific urls that pretty much guarantees cache busting. (usually revision ids and diffs)