[crad]

We make heavy usage of Kinesis Firehose in us-east-1.

Issues started ~1:24am ET and resolved around 7:31am ET.

Then really kicked in at a much larger scale at 10:32am ET.

We're now seeing failures with connections to RDS Postgres and other services.

Console is completely unavailable to me.

[dylan604]

>Issues started ~1:24am ET and resolved around 7:31am ET.

First engineer found a clever hack using bubble gum

>Then really kicked in at a much larger scale at 10:32am ET.

Bubble gum dried out, and the connector lost connection again. Now, connector also fouled by the gum making a full replacement required.

[m3nu]

Route53 is not updating new records. Console is also out.

[grumple]

Kinesis was the cause last Thanksgiving too iirc. It's the backbone of many services.