[michaelt]

  The solution is primarily to include the
  development team in the on-call rotation

...and to have a development team that, at any given time, has 4-8 people experienced enough to support every system that team works on.