You can run Whisper locally, and it is open source.
Feel free to fork this open source project and adapt it to a locally run Whisper instance.