The UID and GID are stored as part of the tar archive. ~/.cpan/.build is just a temporary directory. When you actually install the modules to their final location they should get the correct uid/gid/perms.

What does "making system administration difficult" mean, what is the actual problem? Can't it be solved by chown -R goldens:goldens /home/goldens/.cpan/.build or even rm -r /home/goldens/.cpan/.build?

tar has the --no-same-owner option, but apparently CPAN uses Archive::Tar by default, and I'm not sure if Archive::Tar can do the same kind of thing. Maybe (untested) you could try setting the CPAN option prefer_external_tar and then using the TAR_OPTIONS environment variable to give tar the --no-same-owner option.