[mrVentures]

"You ought to be able to search something on Google and get an answer to your question without signing up for some newsletter."

Call me a cynic but they probably just want you to pay for their journalism. Looks like a cool product, and it's also probably piracy.

[donkarma]

Then it shouldn't appear in search results. I think that's fair

[profmonocle]

Isn't it actually against Google's policy to show different content to the crawler than to actual users? I might be misremembering, but I thought at one point this practice could get you delisted.

[sokoloff]

Google updated that policy (that used to require “first click [from Google SERP] to be free”) in 2017: https://developers.google.com/search/blog/2017/10/enabling-m...

[flemhans]

They say Google is conducting internal deals with Pinterest that foster such behaviour.

I suspect Medium.com and Quora to be in the same boat.

[celdon25]

People should be making new search engines then, not easier ways to access other parts of the same broken system.

[brian-armstrong]

Thankfully the options are not mutually exclusive!

[jerbearito]

Are searching engines specifically for finding free answers? I thought they indexed the web.

[necovek]

They should index accessible web.

You can't search for stuff on your company's intranet, can you? Or your private bank statement?

If someone wants to make something private, it's definitely their right to do so. But they should not attempt to mislead me by offering it as a search result of the public web.

[ziml77]

Why not? The information is available to me if I pay. If it's not indexed, how am I supposed to know it's even there? And if I'm already paying for access to a site, then I certainly want it to show up in Google search results.

[necovek]

Uhm, you go to a web site you subscribe to, and look for it there.

Google is not your private search engine. There is a lot of paid content that Google cannot index and thus search for you: that's a natural order for me.

Now, I am fine if Google shows those results for you. But it also shows it for me, and I ain't a subscriber.

Now, I understand Google is not what it used to be, so it's simply a bad search engine for me. Writing is on the wall, though: they are losing the geek out there, and while they won't be gone anytime soon, they are Microsoft of the 90s (living off of their monopoly).

[jerbearito]

I'd remind you that Google isn't your private search engine either. It's an index of public-facing websites, some with content that requires payment. The job of filtering and discernment is yours.

Perhaps there are search engines that do some of that legwork and you'd prefer to use those, or you could use some of the advanced search techniques available on Google. But suggesting they remove any listings of subscriber-only material seems impractical -- also not helpful to the many people who discover content through search results.

I agree with your last comment:

   they are Microsoft of the 90s (living off of their monopoly)

[Jaruzel]

Then maybe search engines should show a little 'paywalled' tag next to the result so the user is aware before they click?

[ziml77]

I would be perfectly fine with that solution.

[jerbearito]

Are you comparing paid/commercial content to private data that requires authentication? They might both require a login, but c'mon man. Not the same at all. Of course Google doesn't index my company's private intranet. But yes, they do index content that's available to the public but requires a subscription.

[necovek]

They are both behind a login for all practical purposes, right?

If you want to see search results on stuff only you have access to, that should be a special feature by Google: you let it log in using your credentials and crawl away.

I don't have access to it, so I'd rather get results that I care about. This is SEO at its worst, masking results I do want to artificially inflate their ranking.

Maybe I am not looking for a NYT article on it, but instead a wikipedia page. Or a university's history department coverage. Or an actual scientific study. Guess which one will rank higher today while having less objective information?

Now guess why that is? Artifical SEO for paywalled content.