[lappa]

This seems half-baked and there are numerous faulty assumptions in this article. For example, Bitcoin miners cannot computer gradients. Their ASICs can only calculate double-sha256.

Additionally, the premise of sending gradients of models trained on private data while retaining privacy seems problematic. While you likely can't reverse it to calculate the batch's contents, it is leaky.

Further, gradient calculations are not a good proof of work. A good proof of work is difficult to calculate and easy to verify (i.e. an extremely low hash value).

The core premise, using blockchains to store terabytes of models and datasets, doesn't make any sense whatsoever.

The problems highlighted in this article however are valid, and it would be great to see something like IPFS for datasets and models.

[jerpint]

This was my reaction too. How do you “prove” my gradient is valid?

Well perhaps one way is you could have another LLM take a look at the data you are submitting and have it predict p(useful|not useful) , and create an incentive for users to generate authentic data

[synctext]

Indeed very half-baked.

This must be quite an insult to the inventor of fully decentralised AI. In 2012 Prof. Jelasity invented gradient mining with SGD, https://arxiv.org/pdf/1109.1396 Works reasonably well, you probably also need a ledger like Trustchain for accountability and Sybil protection. Consensus is too costly. This problem is unsolved and actively worked on academia for decades.

[riku_iki]

> This was my reaction too. How do you “prove” my gradient is valid?

you can randomly ask sometimes 4 different nodes to calculate the same gradient, and see who is cheeting.

[m00dy]

Ian (Goodfellow), is that you ?

[visarga]

Every time there is a discriminator, someone suspects Ian.

[rayuela]

Yeah, let's not be so adversarial towards Ian.

[3cats-in-a-coat]

The saying "blockchains are a solution in search of a problem" gets funnier every day.

[tromp]

> A good proof of work is difficult to calculate and easy to verify (i.e. an extremely low hash value).

That's a specific Proof-of-Work system known as Hashcash [1]. There are many others, such as Cuckoo Cycle, in which the solution is a fixed-length cycle in a random bipartite graph [2].

[1] https://en.wikipedia.org/wiki/Hashcash

[2] http://cryptorials.io/beyond-hashcash-proof-work-theres-mini...