The metrics they use are not the same, so I am not sure if the AWS option is something dedicated vs the MSFT one is something you share? Is there something different from AWS that is more comparable?
I think the AWS Cloud HSM is dedicated, but not sure. They look to be about the same.
If you don't need FIPS, AWS also has the new KMS service which is way cheaper than Cloud HSM.