I found a temporary solution to the problem which was to "deactivate" perlbrew by renaming ~/.perl5 and removing it from the path.

If I want to put perlbrew back, is there an easy way to find out what packages I had in the old version?