Hacker News new | ask | show | jobs
by ernopp 1810 days ago
Nice post.

For permanent storage you should check out https://www.arweave.org/ rather than IPFS + centralised pinning services like Pinata. With Arweave you pay a small upfront fee to have the network store your file forever.

It's the promise of IPFS+Filecoin but actually live and being used (eg by the Internet Archive). There's some decent tooling & docs for it too: https://github.com/ArweaveTeam/arweave-deploy

Edit: Filecoin is also live and being used, I was out of date. https://docs.filecoin.io/store/

4 comments

Looks like you may be able to use IPFS addresses with data stored in Arweave so that Arweave becomes effectively one of the several redundant hosts you might use with IPFS, if I understand it right.

"This Arweave+IPFS bridge allows you to have truly permanent backing of your data using Arweave, while also making it available in IPFS." [1]

[1] https://arweave.medium.com/arweave-ipfs-persistence-for-the-...

Forgot about this. Thanks!
Filecoin is live and being used, could you clarify what you mean? See eg Textile, Fleek, etc. It is currently storing ~20 PiB across ~1 million storage deals, according to https://storage.filecoin.io.
I read the Filecoin docs and it completely fails to explain the economic incentive. Can someone fill me in? Miners receive Filecoins as reward for storing people's data, who pay Filecoin to access their files. So... the only use for Filecoin is to gain storage access? Why would a miner, who by definition has storage, want a currency that can only buy more storage? Is there something else one can buy with Filecoin? According to Coinbase, Filecoins are "worth $50", meaning they can be traded for dollars?
People who want storage but don't have it must first buy Filecoin, which creates a market to exchange Filecoin to and from other (crypto or not) currencies. Miners sell their Filecoin on that market.
they can just sell it? What's the problem there?
Thanks, I didn't know. I've updated my original comment
> With Arweave you pay a small upfront fee to have the network store your file forever.

How are the economics of this sustainable? "Forever" hosting for a small upfront fee seems like it must be a lie.

Can you only upload small files, so you end up paying 1000x+ S3 prices, with the hope that Moore's law outpaces cost of keeping the file online?

Are reads monetized, so unpopular files will inevitably lose the forever guarantee?

Seems like distributed file systems have a 'choice triangle': permanent, cheap or "doesn't allow hosting child porn" - choose one.
the fee pays into an endowment. the endowment is only paid out to miners if the block reward in USD terms is too low to justify storing the full weave.
So, if block reward value grows more slowly than the stored data, the endowment gets drained and when it hits zero the system implodes?

Seems like an obfuscation of the economic problem that doesn't solve it.

the size of the fee is a function of 1) the amount of data you wish to store and 2) the estimated cost of storing the weave between the current time and the end of the storage period ("forever" is actually assumed to be about 200 years for these purposes).

If you were to store 100 TB on the weave tomorrow (the weave is currently 10TB), the block reward would remain the same, but the endowment payout would trigger much sooner.

The endowment fees are sized with the assumption that the endowment will have to pay out immediately and until the end of the 200 year period.

Ah, that makes sense. I think their 'sales pitch' would be more compelling to more technical users (which I assume is the main initial demographic) if the 'forever's had asterisks and the 200+ year assumption was prominently displayed on landing page.

That shifts my expectations from "economically infeasible lie" to "small fee may not be so small, but feasible with proper stewardship and valuable for certain use cases."

In the crypto/DeFi space, superlative marketing copy is more likely to be interpreted as 'potential scam' than other domains IMO.

Amazing, thanks I'll check it out!