I built this Chrome extension using similar logic to youtube-dl: https://chromewebstore.google.com/detail/audio-only-youtube/...
Eventually couldn't keep up with maintenance and leave it, sigh.