Hacker News new | ask | show | jobs
by livinginfear 1043 days ago
I've donated multiple times to IA. I can't live without the Wayback Machine. I have a question about the Wayback Machine that someone here might know the answer to: Sometimes a website may be imaged 10 times across the years, but hasn't changed since the first time it was crawled. Is there some system in place to avoid storing the redundant, duplicate data?