[ic4ru5]

Perhaps you can add a check for ai.txt as well? Not sure how it compares with just having a robots.txt, though.

[cwbuilds]

Okay, will do - thanks.