[sandblast]

No, in fact I don't. But this post wouldn't be of any help anyway. It feels like it's about nothing, there is no substance, just stating some obvious facts. Without examples that lead to some real recommendations, this whole expertise claimed by the author is of no use.

[amiga386]

> expertise claimed by the author

The author is on record as trying to remove HTTP 418 "I'm a teapot" support from NodeJS, which resulted in backlash and Python adding support for it.

https://en.wikipedia.org/wiki/Hyper_Text_Coffee_Pot_Control_...

[jihadjihad]

Wow. Talk about a storm in a teapot...

[AlienRobot]

Not many people could have gotten that done. Sounds like expertise to me.

[inigyou]

Back in 2018 when the internet wasn't completely fun, but still more fun than today...

[thefifthsetpin]

That's harsh. I believe the author really does get questions from people who want to register a well known path, and probably some of them really failed to consider sites with ~user paths or whathaveyou and this post might push them to use a better solution.

And if you read that and still feel confident that you want a well known url, he links you to the registration process.

[wseqyrku]

The point of the post was that you need to add robots.txt (or similar) because it's a thing, and also tell us where they are.

[Geezus_42]

> add a robots.txt

Which bots will then ignore.

[Ferret7446]

I didn't expect I'd get to use this so soon. Obligatory canned advisory:

https://www.felesatra.moe/blog/2026/06/19/robots

[Geezus_42]

They still ignore it and scan everything even though you have told them not to scan certain paths.