Hacker News new | ask | show | jobs
by jamesponddotco 2182 days ago
I would pay up to $120 per month for a search engine that had its own crawler, and was completely open source, as long as it worked with JS disabled.

The crawler is, arguably, the hardest part. We have open source search engines out there, like searx[1], but most of them are search aggregators, and depend on Google, Bing, and a few other established search engines.

[1] https://github.com/asciimoo/searx

2 comments

> $120 per month

Though I'm curious if there's an actual market for a monthly-subscription Google competitor, I very much doubt this bid would be representative of it.

I do not think there is a market for this — a big one, anyway —, and agree that what I would pay is not representative of what others would, I was just answering the question ¯\_(ツ)_/¯
+1 I appreciate your answer!
Is common crawl usable in this context? http://commoncrawl.org/
Kinda. The crawler is there, still missing the search engine. Think Google, but open source, and maybe self-hostable[1].

[1] I am pretty sure "hostable" is not a word.

The only public search engine that I'm aware of using common crawl is ChatNoir.

https://groups.google.com/d/msg/common-crawl/3o2dOHpeRxo/H2O...