Hacker News new | ask | show | jobs
by ambicapter 93 days ago
Anyone can run a blog/website and be subject to AI bot crawlers using terabytes of your bandwidth for no reason, yeah.
3 comments

Bandwidth is only expensive in the US, somehow. Here in Germany I didn't bother about bots and their additional traffic since 1998 (there are other annoying things about bots though).
If this encourages those people to stop sending hundreds of megabytes of crap per page load of their text content, it might be a good thing
More than that, it's practically impossible to find good specialized, human-written websites. Search engines don't find them, all results are AI garbage. With no real ability to be discovered, there's no incentive to maintain such websites too, and so the cycle of slop continues.
Kagi small Web, though their rss only seems to show 5 updates a day across thousands of sites. Also search for indieweb