but only copied the .pm files

The error messages make it pretty obvious that this isn't the case. Perl wouldn't say "Can't load $very_specific_path/$mod.so" unless it found a *.so file. Even if it did, the "can't load" would then have a reason of "no such file" not a specific complaint about a symbol reference found in that *.so file not being resolved.