I have to do a similar thing.

What works for me is that I use subversion svn:externals tag to create a link to CPAN source control version of desired package then build that whenever I need to deploy as part of my deployment process.

ps: this only works if there is a repository available in the first place, but I seem to have always found one for code I am interested in