OS-native dictation on iOS requires uploading your address book to Apple on every request, even if you don’t use iCloud. I unfortunately have to leave it disabled for this reason.
I believe you're correct as of the last few iPhone generations. iOS 27 (with newer models of device required) have even better transcription coming as well, all on device.