|
|
|
|
|
|
by le-mark
32 days ago
|
|
|
> then what exactly do I gain by allowing Googlebot to crawl my sites? The counter argument is that sites are becoming more AI slop or may intentionally provide poison they don’t want to train on. There may be a cut off date after which training must be carefully curated; and the main body of data has already been collected. Sites may still get traffic from agents searching for current information. Maybe even the resurgence of RSS? One can dream. |
|
|