[ganeshkrishnan]

This search engine seems to use only tf-idf inverted index for it searches and then a vector space model for ranking the similarity.

A search for "java twitter bot" places more emphasis on "bot" then on Java and then on twitter which is what a tf-idf would do.

A good start like you said but it's miles away even from yahoo or bing.

[6502nerdface]

Wow, the contrast between what this engine returns for that query and what google returns is amazing. Literally zero relevant links from the former and only relevant links from the latter. Search relevance is a serious high-science research problem, and it's going to be tough to compete with established players that have probably man-centuries' worth of proprietary research IP and some of the world's best scientists.

[ganeshkrishnan]

>Search relevance is a serious high-science research problem

We are working on this scenario at http://www.shoten.xyz using document clustering and apache spark graphx+ giraph.

Ain't been an easy task so far but we have made some headway