Only if you get to the "nothing left to remove point", and then remove something else. It's best for something to be minimal, as long as it's not also insufficient.
It can scarcely be denied that the supreme goal of all theory is to make the irreducible basic elements as simple and as few as possible without having to surrender the adequate representation of a single datum of experience.