|
|
|
|
|
|
by andybak
1262 days ago
|
|
|
Maybe robots.txt IS the robots.txt for AI. If you want to be indexed then maybe also being used in training data isn't entirely unfair. There has to be some cost involved otherwise it will become a casual default which I could argue incurs a cost to everyone else. |
|
|