[skillplayed]

I am building my own search engine with its own index. The reason for doing so is that most privacy focused search engines function as a middleman between Google/Bing and/or fill their results with AI slop. Any feedback is highly appreciated! I just crossed 110mln results indexed today and am crawling ~500 per second.

[n1xis10t]

Wow, so ~43 million a day, ~15 billion a year? That’s sick.

How much space do you have on the server, and how many pages do you intend to scale to?