Hacker News new | ask | show | jobs
by _xnmw 1634 days ago
YaCy is too slow for mainstream use. I believe the indices still need to be centralized, only index-building and crawling can be distributed.
1 comments

A big part of the problem I see with decentralized search is that you basically need to traverse the index in orthogonal axes to assemble search results. First you need to search word-wise in order to get result candidates, then sort them rank-wise to get relevant results (this also hinges upon an agreed-upon ranking of domains). That's a damn hard nut to crack for a distributed system.

Crawling is also not as resource consuming as you might think. Sure you can distribute it, but there isn't a huge benefit to this.