You could try the portable version [1]. Not so easy to update afterwards, of course, and plugin installations and updates might need some extra steps [2] but having a zipped backup / ready-to-go package, with everything configured as desired, can come in handy.