|
|
|
|
|
by jmunsch
2827 days ago
|
|
"Common Crawl" and Elastic Search? Elastic Search for ipfs. Adding a few petabytes with a lot of bandwidth to ipfs, maybe modifying the warc/wat headers to support ipfs address pinning? Some extra web browser code to sanitize, token harvest, pipe webpages that users visit back into the indexing/pinning locally with metadata for times visited and other counts, with a ui that allows user to pick and choose what gets indexed. Some extras around front page click through thrashing because of poor results, incentivizing quality with upvotes/downvotes/flags, charging for search, and paying for it with resource (bandwidth/storage) commitments. |
|