Hacker News new | ask | show | jobs
by mrgalaxy 1384 days ago
> Also DuckDuckGo sources from far more than just Bing and it does have its own crawler as well.

Do you have a source for this? I'd be interested in reading the technicals of merging search results from multiple sources.

2 comments

They do use their crawler to source some "smart" results, but the bulk of ordinary results seems to be from Bing.
Yep, DDG admists this (blog post from a few weeks back). When DDG first started, most of their results came from Yandex IIRC.
When I was looking into it I only found a few high level things like https://help.duckduckgo.com/duckduckgo-help-pages/results/so.... Nothing on how the sausage is made unfortunately. Same for Kagi which takes a similar layered approach (though anecdotally it seemed a bit more spread across backend sources).