The reason I ask is that a long time ago I used File::Find and I tried to limit the number of files found by dying after n found files. In that situation, the side effect became a problem.

Use Cwd to get the current directory before the call to File::Find. chdir back to that directory after you've finished.

File::Find already makes use of Cwd anyway, so there's no overhead of using that module yourself.