Yes. This is just a cache and the cpan utility stores your configuration there. You can always delete .cpan/build and .cpan/sources, which is where the bulk lives.