I will say that I believe that it's not harder because of any innate fact but because people give up and go back to native.
My speech pathologist/therapist friends hate me.