>1 in every 400 people on earth died from this disease.
1 in 400 people are (estimated) excess deaths during the pandemic. This is not the same thing as claiming that all of them were in fact killed by the disease itself.
I agree, the disease itself might not have killed as many, but the effects of the pandemic most likely did. It was by far the largest deviation from the norm during the time and therefore carries by far the largest responsibility of excess deaths (as excess deaths are deaths outside of what would be ordinary).