Are you saying that you were not ready for the class with all installed modules? :)
On a serious tone: Not going through all tests might reveal mistical problems and failures afterwards. Especially, if you install a module as a dependancy for another module. Sometimes things can get really deeply interconnected (thing HTML::Mason).
I am thinking more in the ways of My::Module::Simple, which would have less functionality, and therefor less dependencies and tests. It could also give a preview of what My::Module is actually doing and if I need to go through all the hassle of the full-featured installation.