This is one use case of Module::Load::Conditional which is itself a core module.

Addendum: Having gone searching for something even more intuitive I have found Best which does exactly what you are after. Even though it isn't a core module, the docs include a section for coping with that. Perhaps this combination approach will serve you well.