The easiest way to reconfigure just one thing is to know its name and to change that from within cpan:

cpan> o conf foo bar
[download]

The conf command lists all configuration items:

cpan> o conf
[download]

If you don't find things there, another way is to edit CPAN/Config.pm and to change the values there.