[conradfr]

There is the --ignore-crawlers argument, on my modest projects it seems efficient but I've not look at it too precisely.

[alias_neo]

I've always had this flag in my run script but find I still have huge amounts of crawler traffic. I might need to look at that again.