This implementation says: “A Tesla K80 needs around ~4 minutes for generating a second of audio at a sampling rate of 4000hz”, which is significantly faster.
90 minutes for 1s of audio was reported by someone from Google on twitter, but the tweet has been deleted.
I've clarified in the readme that my measurements are for a much lighter/smaller model than Deepmind's :).