Most of these classes are of no interest to the end user, and I am wondering if there is a way to keep them from showing up in the CPAN listings?

You can also use the no_index attribute of your modules META.yml.