There might be some way to do this using File::Copy::Recursive but I could not spot it in the documentation.

Contrarily, it is certainly possible with File::Rsync instead. This gives you most of the goodies available in rsync but with a Perlish interface so you can do both local and remote tree copies with exclusions.