Y
Hacker News
new
|
ask
|
show
|
jobs
by
qwertox
436 days ago
Maybe the big tech providers should play fair and host the downloadable database for those bots as well as crawlable mirrors.