[markus_zhang]

I wonder if one can build maze webpages to trap these AI crawlers. So if it's a human it doesn't bother, but once identified as a crawler it dynamically generates webpages after webpages of garbage. It doesn't need to save all those garbage but the crawler has to.

[KomoD]

I did see someone here on HN that did that, but not specifically for AI crawlers. Every page had links to more pages and those pages had links to even more pages (and it just goes on forever)