[tonyhb]

That's awesome! Seems like a really solid setup. Bufferapp took a page from your book and have the same deploy setup with hubot... it works out really well for them, too.

I have three questions to ask about DB migrations (which I can guess the answers to but would love to hear directly), if that's okay:

How do you handle a DB migration with a staged rollout (two 2 of N production servers)?

How do you organise timing between a migration deploy and code deploy if one is done before the other?

How do you handle rollbacks?

[technoweenie]

Migrations stay pretty small. Most of them just add a column or index. We also have to make sure tables aren't too hot to migrate. See a previous post for more on that: http://githubengineering.com/using-mysql-performance-schema-...

It's also really important that migrations don't affect the running app code. New columns shouldn't be used yet. Removed columns or tables need to have all references removed first before running the migration. We confirm this with a deprecation helper that sends metrics to Graphite.

That's about all I can answer from the app side :)

[tonyhb]

Sweet, that makes sense. Thanks for answering!

Was assuming that a column rename would duplicate the column during the first migration — so that the old and new codebase would work correctly. I guess the only complication is that you need to keep track of which branches have been successfully rebased/merged to master so you can run the second cleanup migrations.

Thanks again!