|
|
|
|
|
|
by ColinHayhurst
1984 days ago
|
|
|
At Mojeek which also has it's own crawler/index, like Blekko, we see around 80% bot searches. That % has also grown as we grow. Would syndication search services, like DDG or Startpage, see a higher level of bot traffic than a crawler search engine? We don't know and it could depend on several factors. Bot traffic handling is certainly an ongoing and important challenge. |
|
|