in reply to Perl file operations

While I don't have a directory with 60,000 files in it to test your code I would guess that  <*.txt> is creating such a large list that it runs out of memory.    Try using opendir and then readdir in a while loop to cut down on memory usage: 

opendir my $DH, '.' or die "Cannot open the current directory: $!";

while ( my $file = readdir $DH ) {
    next if '.txt' ne substr $file, -4;

[download]

Replies are listed 'Best First'.
Re^2: Perl file operations
by chromatic (Archbishop) on Feb 23, 2008 at 04:42 UTC
    While I don't have a directory with 60,000 files in it to test your code I would guess that <*.txt> is creating such a large list that it runs out of memory.

    At an estimate of 64 bytes of overhead per SV, 60,000 strings produced by that list will take up 3.6 megabytes of memory, not counting the lengths of the filenames.

[reply]
[d/l]
      Monks,
      I am stupid. The file extensions in the directory were different that I was expecting.
      I fixed the file extension, and it slowly but surely processed the 60,000+ files into their respective directories. I watched memory usage on the successfull run, and it hovered between 60 and 70 megabytes, using Activeperl.
      Please dont harm me :(
[reply]
        We'll hold off on the crucifixion.
[reply]

In Section Seekers of Perl Wisdom