[hephaes7us]

FUTO keyboard is trying to do this. I think they have some kind of distillation of Whisper running on-device.

[fph]

They are just shipping the same whisper-small that everyone else is using, and did not much to improve their models since release. Other models have been "coming soon" forever. https://keyboard.futo.org/voice-input-models