|
|
|
|
|
|
by echo42null
325 days ago
|
|
|
Hmm, I’ve always seen robots.txt more as a polite request than an actual rule. Sure, Google has to follow it because they’re a big company and need to respect certain laws or internal policies. But for everyone else, it’s basically just a “please don’t” sign, not a legal requirement or? |
|
|