[ewbourget]

This is Erik from the Square engineering team. Our service has been restored; we will be following our standard postmortem process and will be making the results of this one public. We currently believe that this was caused by a bad deploy followed by a thundering herd capacity problem in our authentication service - no DDOS attack, etc.

History and details are available at issquareup.com.

We apologize for the downtime; this situation is well outside what we expect of our service and of ourselves.

[ewbourget]

Posted: https://medium.com/square-corner-blog/incident-summary-2017-...

Please feel free to email me at ewb_at_squareup.com with any questions. Again, we apologize for the outage and take remediation of these issues seriously.

Less technical version: https://www.issquareup.com/incidents/y4mrzjz0nl2d

[cypherpunks01]

Thanks Erik. Where will the postmortem be posted?

[ewbourget]

It will be posted on issquareup.com.