Hacker News new | ask | show | jobs
by badlibrarian 501 days ago
I would classify the end of term web archive (which archive.org is, in its typical fashion, taking far too much credit for) as an example of entities doing things right.

https://eotarchive.org/partners/

And saying "archive.org is outside the reach of the US government" -- hell, it's not even outside the reach of the RIAA or the book company with the little penguin on the cover.

We should have proper supervised federal archiving and archive.org should be far better run, too.

And I don't know what Archive Team is but maybe they could update their site to provide some information on the people involved. And perhaps update their understanding of what's possible with docker containers while they're at it.

Because the counterpoint to a radicalized Musk screwing around with government databases isn't an opposing group of anonymous radicals screwing around with commercial databases.

2 comments

I'm interested in why you are saying that the Internet Archive is taking too much credit for the end of term web archive. The website you link to demonstrates that it's run by the Internet Archive, although various partners have joined it since it began.

Is that not correct?

> And I don't know what Archive Team is but maybe they could update their site to provide some information on the people involved.

You don't need to reveal your identity, but looking through your comments, it looks like you originally spun up this account to criticize the Internet Archive. I'll just note that accusing others of being "anonymous radicals" falls a little flatter when you're anonymous yourself.

(Relevant disclosure: I've worked with IA and Brewster Kahle, and defended him here before.)

> Is that not correct?

It's not run by the Archive. It's a collaboration. They didn't even do all the crawling, and the Library of Congress keeps a copy.

https://eotarchive.org/about/

As for Archive Team, their site declares "Archive Team is a loose collective of rogue archivists, programmers, writers and loudmouths."

Dedication is great. And radicalization in response to copyright and preservation certainly deserves some leeway. But a little professionalism wouldn't hurt and the 2600-era roleplay isn't fooling anyone.

Agree the US government should contribute in some capacity. Agree they should be robustly funded to do this. But, checks and balances are also important, and when a node goes rouge or dark, the system must be fault tolerant and operate when degradation occurs. I previously said "I trust Brewster and the rest of the IA gang more than the US government to safeguard the Internet Archive." [1] I feel this assertion has been proven out over the last few weeks.

ArchiveTeam stands on its own as an independent, community driven volunteer digital archival and preservation effort. If you don't understand why, what, and how they operate, look closer and be more curious [2].

[1] https://news.ycombinator.com/item?id=41984664

[2] https://en.wikipedia.org/wiki/Wikipedia:Chesterton%27s_fence

If the checks and balances of NARA and LOC (6,000 employees, $1.5 billion in annual funding) is Brewster Kahle asking for $10 on pages serving pirated Nintendo games, then we're in a bit of trouble, aren't we?
On the contrary, the fact that a single person's charitable digital archive can stand toe to toe with a global superpower's archival efforts is a sign that success is possible. We may see things differently though, and that's fine. Would I want to fund NARA and LOC more? Or the Internet Archive? I prefer the latter. Checks and balances. I have donated $10 on your behalf (in addition to my annual donations).

(lots of good people at NARA and the LOC, but they are subject to the whims of the US electorate, which is not great; the Internet Archive is not)

I think archive.org deserves more funding and I also think they need to decide if they're an archive, a library, or a pirate site. Since each has a different set of costs, legal risk, and projected longevity.

For the record my opinion is that they need to focus on archival and with a few tweaks could make it safe for more users to upload more material. Going legit archive (as their name implies) instead of hiding behind the DMCA and playing high-stakes poker with copyright law would also make it possible for more entities to provide direct support.

I also disagree that NARA and LoC is subject to whims of the electorate. The Library of Congress is set up to serve, well, Congress. Who funds it. Lotta barriers to cross there, even in these weird times.

I'll take that risk over one guy with limited governance who seems genuinely surprised that he keeps gets hacked and sued. There's a chance the whole thing goes away because he couldn't resist serving up free Frank Sinatra records and got hit with a $621 million lawsuit after he thrice refused to take the stuff down.

> I also disagree that NARA and LoC is subject to whims of the electorate.

National Archives Workers Unsure If Marco Rubio Has Secretly Been Their Boss for Weeks - https://www.404media.co/national-archives-workers-unsure-if-... - February 6th, 2025

Trump dismisses head of the National Archives - https://www.nbcnews.com/politics/donald-trump/trump-dismisse... - February 7th, 2025