Hacker News new | ask | show | jobs
by ushercakes 948 days ago
It's not just you - this is widespread.

I run a SaaS to help site owners get their content indexed. We're seeing an influx of users, I think a lot of the issue is simply because of AI.

New web page additions were pretty linear over time, and then AI copywriting tools came out. Suddenly page additions basically went "hockey stick"/vertical.

Now, you can publish thousands of pages in a few minutes, and it's created a huge backlog in Googles crawl queue, thus increasing overall time to get indexation, disproportionally affecting smaller sites.

2 comments

> I run a SaaS to help site owners get their content indexed. We're seeing an influx of users, I think a lot of the issue is simply because of AI.

I think that google just isn't interested in putting resources into their search engine anymore. They used to need it to gather data on people and what they were doing online, but chrome gives them people's internet histories now and android lets them collect endless amounts of data on people's lives offline. Google doesn't need search to spy on us anymore. It's only natural that they'd let it stagnate.

Sites are actively being deindexed. My entire website, probably 20 years old now, used to be indexed. Now only a few pages are.