Which there may still be other side channels, and other things, but the naive version of that attack sounds a little unlikely.