readdir returns an unqualified file name, so when you use -d, you are looking in the current directory for a file that's in another directory.

You should consider using File::Find::Rule or similar.