[ajkjk]

I don't think that argument is actually true? You can refactor for purely aesthetic reasons and it may well turn out to help. Maybe you don't even know, going in, what the goal is; just that the way it works now isn't good and maybe if you start looking you'll find a better approach. Happens all the time, I think. Of course you can also refactor for aesthetic reasons and not help, but that's a skill issue.

My clue-finding and pattern-matching and such is all based on philosophical aesthetics: something feels amiss when these patterns exist without being obvious; therefore they should be extracted and examined from various sides to see if a connection is found.