> should make cloud GPU time cheaper and/or more efficient.
No way. These will be not put in data centers of cloud providers. I'm not even sure many regular data centers will have anything like this -- especially if NVIDIA keeps pushing and blackmailing server vendors to stop selling servers packed with GeForce cards if they don't want to loose big [1,2].