use the grep function :

@allfiles = grep { m/^xxxx/ } readdir THEDIR;
[download]

And you'll need to modify your $numfiles calculation ...