[shermantanktop]

These models are notably terrible at music in every dimension.

Music is essentially mathematical. Weakness in math is being addressed by dedicated capabilities that are triggered by mathematical language in prompts, but because these models are actually terrible at math there is no lateral transfer of skill to the domain of music. That's my theory anyway.