Hacker News new | ask | show | jobs
by jaredwiener 5 days ago
But it also destroys the business model behind the site.

Sure, you could technically redesign to handle the bot traffic, but if the bot traffic is just taking the data and reducing any need for humans to visit the site, why is he putting in the effort to maintain the site?
2 comments
tptacek 5 days ago
The business model of the site is apparently private data sales, not ad revenue.
link
jaredwiener 5 days ago
Bots don't make purchasing decisions.
link
Terr_ 5 days ago
Some people are already trying to make that happen, but I'm convinced it'll be a net-negative.
link
jaredwiener 5 days ago
Rephrase: Bots SHOULDNT make purchasing decisions.
link
fragmede 5 days ago
Because... ? If I'm operating a site, and I want $X to allow a bot to scrape my site, why shouldn't the bot be allowed to make the purchasing decision to scrape the site? Obviously the bot owner would have their own set of guardrails, but if it allows sites like The numbers to stay up because bots aren't going to look at ads so the old model of displaying ads isn't going to work, I have a hard time seeing that as a bad thing.
link
jaredwiener 5 days ago
I mean it from the consumer perspective.
link
FinnKuhn 5 days ago
According to the post inquiries for purchasing the data increased as a result though so they might not make the decision, but they do make the suggestion.
link
hyperhello 5 days ago
Well, why is he? If it's for ad revenue, this problem is surely global to the web. If it's because he likes to do it, it shouldn't matter if one AI or a trillion scrape the site. I feel like we badly need a rethink of the web architecture after DoubleClick anyway. Maybe the name of the game should be to cut down a site's assets very hard and use static hosting for them. This interferes with crummy sites that show a mess of inlined ads every refresh, but now that there are a billion 'poor users' this is no longer feasible.
link
jaredwiener 5 days ago
Maybe more an inherent problem with these chatbots.

LLMs are great, but they aren't producing new information. You still need people for that. But if you cut down any incentive for the people to do that, the LLMs will starve.

link