A quick and dirty method I've used in the past is when it starts asking the questions to config perl, control-c and then restart CPAN (and resume doing whatever you were trying before.) CPAN thinks there's a problem installing the new perl and skips it.