Personally, I would install everything relevant upfront just to be sure that the installation is in a known good state.

An alternative could be to inform the user about the recommended modules using the recommends keyword in Module::CPANfile (if you use a cpanfile to install the prerequisites).