Hacker News new | ask | show | jobs
by ColinHayhurst 699 days ago
It's a very long article so understandable that you did not read on and learn about other search engines crawling beyond GBY. Still there are indeed very few that are crawling at web scale, and internationally. We are at 8 billion pages and totally independent [0], hence expressing our concerns to 404 media after being blanked by Reddit.

[0] https://www.mojeek.com/about/why-mojeek
2 comments
WarOnPrivacy 699 days ago
> did not read on and learn about other search engines crawling beyond GBY. Still there are indeed very few that are crawling at web scale, and internationally

That's helpful clarification.

In criticism of the article, you might agree that

none of them have their own results

is a fairly absolute statement. It signals: Final word on the matter; no nuance to follow.

link
topaz0 699 days ago
Omitting the "almost" from "almost none" makes it sound disingenuously more absolute than it actually is.
link
WarOnPrivacy 697 days ago
> Omitting the "almost" from "almost none" makes it sound disingenuously more absolute than it actually is.

Except that isn't what happened. Within the context, 'almost none' referred to size of the group, not to the amount of crawling.

I was discussing how much crawling is being done - outside of the 'almost none' sized group.

The 'almost none' sized group has 'their own results', so they do crawl. Based on that, the rest do not. Ergo, they do not crawl.

A search engine that never crawls seems non-intuitive.

link
shadowgovt 699 days ago
I mean, I didn't read on because it's paid.

I'm not taking their reporting without compensation, but that also means I didn't have the whole story. Such is life in this era of the internet.

link