Every launch of the Atlas V has already been sold [1]. They can't make more because it uses the Russian RD-180 engine.
If the Falcons were grounded, we wouldn't have the capacity to replace them with Starliner + Atlas V.
[1] https://www.theverge.com/2021/8/26/22641048/ula-boeing-lockh...