Every time you call dir_names(), you set $dirs{$File::Find::name} to 1, then you increment it.

$dirs{$File::Find::name} will equal 2 after every call to dir_names()!