Because the speaker is still slow, so if it got to it, there should be audio, but maybe the circuit filters out the PWM signal outright?
The PWM-based modulation is interesting, but as an amateur, I couldn't fully understand it or trust that the radio receiver reliably picks up the duty cycle as amplitude.