[codingslave]

Search is just getting worse and worse, its a problem that probably nobody can solve with the current paradigm. I think in a few years there will be a significant opening in the search market for an algorithm that manages to structure information differently

[pjc50]

Search is a battleground. There are huge amounts of money to be made from "worsening" your search results by steering them to inferior products. So search engines and blackhat SEO are locked in a permanent struggle.

[tambourine_man]

Or, some public database of the crawled web where we can apply our own algorithm.

I've always dreamed of a grep for the web, for instance. Trying to Google for code is a pain, even when quoted/verbatim.

[istjohn]

This exists: commoncrawl.org

[Spooky23]

That’s because the web is dead. Lots of passion projects that would have been on a blog or websites are locked into Facebook or even Twitter threads.

My local historical society decided to produce lots of content and exclusively post to Facebook. It’s incredibly dumb, but people seek the easiest path.

[codingslave]

This is a good point, the internet is largely monopolized

[semiotagonal]

Yes. Don't hate the player, hate the game. If the visibility of your work is determined by it's "freshness", then freshening up makes sense. If everyone does this, then Google et al will have to find a better criterion to rank by.