[corresation]

What you say is true if attackers know the composition of your password: If the system provided them with some sort of hints telling them how many upper, lower, digits and special characters existed in the password.

Hopefully such systems don't exist.

Instead most attackers have to run through the obvious, then through brute forcing against the known character set.