Just delete the '*.pm' files that got installed in the library directory. And any files/directories in the 'auto' directory for that module (e.g. for DBI and any DBI::* modules, theres an auto/DBI directory in the same directory as DBI.pm and the top level DBI directory).