Right, Archive::Zip's job is to handle zip files, not delete things. But fortunately there is a core module that will make the deletion trivial:

use File::Path qw/remove_tree/;

remove_tree(@paths);
[download]

Where @paths are the paths/files you included in your Archive::Zip.

See File::Path for more information, including a description of error handling.