| Hi, We are very sorry for Friday's downtime on one of our clusters in Sacramento. We take downtime seriously and we learn from each incident. Yesterday's incident appears to be the result of a software malfunction in 2 or more of 4 switches that handle traffic between a group of servers and their SAN shelves. The switches are from Extreme Networks, which has a good reputation, and they are helping us debug error logs. Organizationally, we are making changes to reduce the incidence of such problems and to always improve how we deal with them in the future. We're expanding the group that focuses on infrastructure design and management. This group looks at ways to improve our technology (design and vendor choices) and human processes. For instance, one of the top people in that group visited a SAN vendor earlier this week to review their latest offerings. If you were affected by this downtime, please contact your account manager to discuss service credits. If you don't know your account manager, please send an email to 'info@engineyard.com' and your message will reach them. Thanks for being our customer, and again, sorry for the downtime. Believe me, when I hear about downtime while on a week off with my dad coming this weekend, it is not pleasant - it actually hurts! --- Lance Walley, CEO
--- Engine Yard |