If you copy a piece of GPL code but change the whitespace or some arbitrary number that produces the same output, does that still still break the license (if you don't make the source public)?
I'm not sure what you mean by that, the GPL only has constraints for redistribution. If you don't distribute anything (publicly or not), there is no way to break the GPL.
Assuming the code you modify is protectible in the first place, then yes, this sort of trivial modification or derivative would be covered by GPL and have to abide by its rules.
But just because you slap a license on something does mean you actually can enforce it.
> if you don't make the source public
I'm not sure what you mean by that, the GPL only has constraints for redistribution. If you don't distribute anything (publicly or not), there is no way to break the GPL.