|
|
|
|
|
by marginalia_nu
1165 days ago
|
|
I guess technically that could be arranged. Although I don't want everyone to run their own crawler. It would annoy a lot of webmasters and end up with even more hurdles to be able to run a crawler. Better to share the data if possible. |
|