Whenever you use a OS call and check for failure it is as well to display $^E as well (or instead of) $!. In this case, you would get the following:

warn $!;
Permission denied
warn $^E
The process cannot access the file because it is being used by another
+ process
[download]

Which makes identifying the problem easier, if not the solution.