Hacker News new | ask | show | jobs
by blackhaj7 240 days ago
Can someone explain how this works?

Surely the bots are still hitting the pages they were hitting before but now they also hit the garbage pages too?

2 comments

In authors setup, sending Markova generated garbage is much lighter on resources than sending static pages. Only bots will continue to follow links to the next piece of garbage and thus he traps bots in garbage. No need to detect bots, they reveal themselves.

But yes, all bots start out on an actual page.

Seems like these garbage pages can't trap bots. People discussed it in this thread: https://news.ycombinator.com/item?id=45711987
Thanks for the explanation!
Ah, it is explained in another post - https://maurycyz.com/projects/trap_bots/

Clever