A problem with public keys is that they rely on math that we presume is hard.
One Time Pads do not depend on that.