I remember taking quantum mechanics as a second year mathematics undergrad in the mid 2000s and - as a mostly pure mathematician - balking at the Dirac delta function. Wasn't until the third year course on principles of QM did things start feeling steady.