What do you expect your output to look like? I'm unclear what you mean by "distinct names" -- i.e. full path? basename?

Your code isn't doing any useful summarizing as it reads, and that's the key to staying within a reasonable memory footprint without using a database.