[thunkingdeep]

Most people visit the same half dozen websites over and over anyways. Websites are eventually going to be an artifact of an old medium as we move to like cybernetics and AR glasses and brain implants and whatever else. All that stuff in websites will be forgotten

[chipsrafferty]

Eh, I think a huge amount of people would never want anything implanted in any part of their body. Most people don't even want smart glasses.

[layer8]

Most people didn’t want to carry a computer around with them all the time 40 years ago as well.

Though I don’t agree that AR would eliminate the usefulness of websites.

[smitty1e]

Except a necessary, special purpose device, e.g. a pacemaker, I wouldn't have anything implanted.

Now, an artificial ear for the deaf starts to be more compelling.

[SoftTalker]

I have read that some deaf people do not want cochlear implants because their deafness is part of who they are, their identity. They don't want that taken away.

[walterbell]

> All that stuff in websites will be forgotten

Why are LLM scraper bots hammering websites globally, if websites will be forgotten?

[immibis]

Because we're a post-competence society. Very little useful data will be gained by the operators of these bots. They don't work, and nobody cares they don't work. We're doing everything cargo-cult now. We're building giant machines that do nothing but spew smoke into the air, because that's what they did in the Industrial Revolution and it brought prosperity, didn't it?

[walterbell]

Hopefully any actual scraper bots are writing data to de-duplicated cloud storage. The rest should be served with Anubis, PoW or other DDOS defenses.

[thunkingdeep]

I would argue that’s a driver to my point. How many people are never going to visit the source website when Llama can give me a detailed summary of what I need in a few hundred milliseconds? I would consider that in the same category of forgotten. I could’ve been more clear in my other comment.

[walterbell]

If a website is not financially dependent on search traffic, they can block all scrapers with a paywall, and their content will be missing from generic LLMs.

If a website is financially dependent on search traffic, they can go out of business due to loss of traffic to LLMs, and their content will disappear everywhere.

If the majority of websites fall into the latter category, LLMs would be left with old/archive longform content, plus micro content from social media.

If social media (e.g. X.AI) takes their data private for vertical integration with payments and internal LLM, their content will be missing from generic LLMs.