|
|
|
|
|
|
by shirtless_coder
5624 days ago
|
|
|
I don't blame them for doing this. They are trying to protect their assets (questions and answers). However, this is not a good move for two reasons: 1. Honoring robots.txt is optional, so this doesn't actually offer any form of asset protection. 2. They are losing serious amounts of exposure that they would reap if they'd lift this restriction so that smaller engines can find them. |
|
|