Yes in the sense that the aim is to avoid overfitting, and to improve generalization, but here the goal is not to favor simpler models but to avoid them, with the presumption that the observed data is a biased sample of reality, and that our natural model building intuition will not correctly make sense of outliers... That kind of thing.