And you would be wrong: diseases which kill die out. Diseases which do not kill spread far and wide: COVID is successful and dangerous precisely because it mostly doesn't kill, and it keeps you on your feet and contagious for a good long time.
They wouldn't need to kill many. Just a few around the world to scare everyone. Heard the DC sniper terrorized people over a longer period but didn't kill that many.