|
|
|
|
|
by jetrink
906 days ago
|
|
> We’ve indexed over 100 million pages > [W]e’re crawling up to a million pages a day, as you can see on our stats page. > Given that Mwmbl is still relatively unknown, it seems plausible that we can reach our target of crawling three billion pages a day, to refresh the entire index in one month. I think this is supposed to read "it seems plausible that we can reach our target of crawling three million pages a day." |
|
Seems you are correct.