My phone is in my pocket, which signficantly degrades the audio quality of any recordings. Same reason I have a cover over my laptop camera, but not over my phone camera.
I've made several audio recordings with my phone in my pocket. Unless you're very consistent with the pocket and placement of your phone, that isn't a significant mitigation.