[est31]

Also the post says that Firefox doesn't work on Androids older than 5.0 which according to the dashboard are still 5.9% of devices.

For those older devices, the only option is to install the new root certificate.

Anyways, there are billions of Android devices out there. 33% of those is a large number. You can't just tell all of them that they are wrong.

If this happens, people will move away from Let's encrypt in masses. They don't realize yet how self-harming this really is.

[WorldMaker]

Root certificate updates are a massive security issue. Blaming Let's Encrypt is blaming one of the canaries for the coal mine disaster. 33% of Android devices don't and can't get up to date root certificates is an impressive security crisis that grows worse by the year (look at the other root expirations and the crazy workarounds that for instance Netflix has been doing to still work on older Android devices). Shouldn't the blame squarely be on Google, the Android OEMs, and the phone carriers for allowing this disaster to happen in the first place?

I realize that is a tough message to get out to users and site owners are going to be in the cross-fire, but it seems better to try to work for solidarity in pointing fingers at the right direction and the right direction certainly isn't Let's Encrypt.

[est31]

Yes the issue is really severe of most deployed Android devices not getting security updates, either at all, or the devices are used well beyond the update period.

But this is not up to Let's Encrypt to solve. They market themselves to build products for the mass market instead of small niches of the market, say, everyone who buys a new phone every year. But then they also have to treat their product like a mass market product, and if Android users still use older versions of the OS, then Let's Encrypt should adopt for that.

[thayne]

This problem isn't unique to Let's Encrypt. Let's Encrypt is not the only entity with certificates signed by DST Root X3. And as these devices get older, more root certificates will expire. What happens when all of them expire?

What is unique about Let's Encrypt, is they may have a harder time getting cross-signed by a CA that will still have a valid root cert on these devices for a significant amount of time, because, as has been pointed out in other comments, Let's Encrypt is disrupting the CA industry.

[jacquesm]

They will be happy to accept that blame, as long as you fork over your $ for a new device. Planned obsolescence can have many components, this is just one of them.

[cpach]

That makes me curious, what workarounds did Netflix employ?

[WorldMaker]

It was the BBC I was actually thinking about, and it's a part of this article (which also mentions this Let's Encrypt root change):

https://scotthelme.co.uk/impending-doom-root-ca-expiring-leg...

Previous HN discussion on that article: https://news.ycombinator.com/item?id=23455463

[Aissen]

When you control the client, it's simple, you can do pretty much anything: embed your own HTTP stack, TLS stack, your QUIC stack, or simply your PKI, or subset of the webPKI.

[kelnos]

If you're running Android 5.0, you also haven't benefited from updates that remove CAs that have since been shown to be untrustworthy. I think that's far worse than being unable to visit sites that use LetsEncrypt certificates.

It was really short-sighted of Google to make the system cert bundle something that can't be updated without a full OS update. There should be an OTA mechanism that allows it to be updated through the Play Store or through some other means that isn't reliant upon lazy device manufacturers.

[thayne]

To be fair they haven't gotten mant other security updates either. It's just a bad situation all around.

[fuzxi]

33% of devices, but per the article, only 1-5% of traffic on sites using LetsEncrypt. I don't see any site owners moving to a different CA when this affects less than 5% of their visitors, who are likely the poorest fraction of their userbase , i.e. probably not many paying users.

[merlyn]

How many other root certificates are going to be expiring in the next 3 years that older Android won't have updates for as well? Probably more than 1.

[notatoad]

on androids older than 5, the browser is the old android browser instead of chrome. how many sites out there still test compatability with that?

even without having to click through security warnings, the web is horribly broken on old android devices. the overlap of sites using letsencrypt and sites that care about people using android <5 has got to be vanishingly small. this isn't going to cause a move away from letsencrypt.

[baggy_trough]

Not sure about that. Move away from Let's Encrypt to what? More likely, most smaller to medium sized sites will say forget those old Android guys.

[est31]

I found at least Buypass offering a gratis ACME product "Buypass Go SSL". They have roots which are deployed at least since Android 4.1, which covers way more Android devices (according to the Android Studio statistics, >99%):

https://android.googlesource.com/platform/libcore/+/android-...

I'm not sure whether that particular root is being used for their Go SSL product. If so, Buypass might be a good alternative to migrate to.

From what I read though, they do require an E-Mail address, so you've got to keep that in mind.

[sroussey]

Too cheap to update can be seen as too cheap to buy your product or service, so I can see this happening.

[TheKIngofBelAir]

> Also the post says that Firefox doesn't work on Androids older than 5.0 which according to the dashboard are still 5.9% of devices. For those older devices, the only option is to install the new root certificate.

Microsoft Edge still gets updates on Android 4.4 KitKat

[w3ll_w3ll_w3ll]

I don't think Microsft Edge embeds its own root store on Android.

[tacon]

Is there enough incentive for Microsoft to add a root store to Edge by next September? How hard is it to make that addition?

[jsjohnst]

I may be wrong, but the effort to switch to your own root store is more doing it securely, than the difficulty of switching from system frameworks to your own SSL/HTTP transport layers. So to put another way, straight forward to do mediocre job, not as trivial to do a good or great job.

[toast0]

Root store and TLS/HTTP library are separate concerns. You can use the system root store with your own libraries, or you can use your own root store with the system libraries.

On an Android 4.4 device, you should probably skip the system root store and the system libraries, and if you're already doing it for those phones, you might as well do it for all the phones.

[jsjohnst]

> Root store and TLS/HTTP library are separate concerns.

In the context of this thread (aka older Android devices), they aren’t truly separate concerns. You really need to do both. My point is that doing both is relatively straightforward, but doing the root store part is fairly easy to do it in a mediocre way and be brittle / insecure.

[maxerickson]

In the post, they advertise that they are going to continue to offer a service that provides certificates signed with the old one.

[capableweb]

That's not gonna help as the root will expire, so the devices stuck with the older root will still shows errors when trying to use them.

[est31]

... which will work until September 2021.

[veeti]

You can still install the last version of Firefox to support Android 4.x.

[toyg]

I don’t think they have a choice. Reading between the lines, the CA who cross-signed their previous root doesn’t really want to continue doing so (or asked for a lot more money) because LE usage reached levels that are just too risky. I don’t blame them: a single bad actor found doing something particularly nefarious with a LE certificate might lose them the trust their business is literally built upon. I don’t see any other CA queueing up to help what is typically their commercial nemesis. And as they say, at some point they would have to do it anyway, might as well rip the plaster off.

[t0astbread]

Agreed, but what could someone do with a domain validation cert (as issued by LE) that would be so nefarious to damage IdenTrust's reputation?