Hacker News new | ask | show | jobs
by klft 2212 days ago
A few years ago, I investigated if there is a business opportunity in quality search.

The biggest hurdle I found no way around is the content. Not all but a lot of high-quality information is paid. You get access to it as a user but not if you want to index it as a platform. And you need a lot of different providers to have good coverage. That might get easier if you have lots of users, but you do not get users without content. The platform chicken-egg problem.

Profitable niches like Bloomberg’s business information definitively exist but this would not be the high-quality generic search engine you described.

1 comments

That's really interesting to know, thanks. I think for my purposes a lot of high-quality information isn't paid - it's academic, policy, and nonprofit sources mainly. I feel like you could make a lot of improvement for my purposes just by:

- Downweighting commercial sources and upweighting academic, government, and nonprofit sources.

- Using some measure of quality, maybe even something simple like length + reading age?

- Building big whitelists of quality sites and blacklists of low-quality sites, as picked by human curators and users

Beyond this, perhaps users could plug in sources that are particularly useful for them, including ones they have subscriptions to. I've thought it would be handy to have search results include ebooks, papers, and notes on my computer, for example.

But maybe the userbase of people who need high quality, non-subscription info is too small to get this started.

Interesting feedback. Thanks!

> a lot of high-quality information isn't paid

Maybe I was biased towards paid content because I did an enterprise search project on scientific articles before.

> users could plug in sources that are particularly useful for them

That could work if you have a local copy of the data which can be indexed. E-Book DRM might be a problem.

> But maybe the userbase of people who need high quality, non-subscription info is too small to get this started.

That was my impression. I almost always got puzzled looks when I described the idea. And most of those people were “knowledge workers”. But if you are a specialist, you already know where to look for the information you need in your area of expertise.