Hacker News new | ask | show | jobs
by no_circuit 1519 days ago
That sounds exactly like how search works today. Anyone can make a payment to promote their site for a topic which is equivalent to demoting someone else's. Crypto isn't necessary. The ability to anonymize up and down weights probably will make spammy results worse. Unless one is purchasing ads to drive traffic to one's site, what would be the motivation to help maintain indices that help some one else's web search business?
1 comments

> That sounds exactly like how search works today.

Problem is that today what is indexed is under the sole discretion of the one entity generating the index, and the state of the index at any given time has no way for anyone to tell if it was modified outside the boundaries of the code that generated it from the previous timestemp (or if the code itself was changed between time intervals for index generation). The public has no access to these things because they are controlled by individual companies now.

For it to become decentralized, the code used to generate the indecies needs to be public, the state of the indecies at any given time needs to become public and verified by some cryptographic hash, and the software that serves results based on such incecises need to have a way of agreeing on incidies at any given time such that if an index someone searches against is modified, anyone would be able to tell that the server that served the result is byzantine from the network.

I can imagine, as an naive example, compressed tf-idf matricies that correspond to a given hash for search indecies and search interactions (what data the software tracks when someone does a look up against it or wants to increment a weight of anything in the indecies) and gossiped to other connected servers over some time interval, which can verify that at x time, the index was y and the weights matrix was z.

> The ability to anonymize up and down weights probably will make spammy results worse.

Not if the cost in doing so gets more expensive over time for any given result.

> Anyone can make a payment to promote their site for a topic which is equivalent to demoting someone else's.

This process isn't formalized across search indecies, each company that makes one has their own rules, and what the exact rules are at each time delta is not clear to users of search engines. And all rely upon easily censorable financial systems.

> what would be the motivation to help maintain indices that help some one else's web search business?

People or companies running the software could collect fees to maintain the distributed search engine. If they modify the code to the degree it operates outside of the how consensus is defined in the code others are running, other nodes could block that node and their fees could be blocked as defined in their code.