I recommend App::pmuninstall for this task:
pm-uninstall [options] Module
https://metacpan.org/pod/pm-uninstall