in reply to Re^2: Robocopy log parsing
in thread Robocopy log parsing

I think you want something like that:

use warnings;
use strict;

my $filename = $ARGV[0];
#$filename = 'robocopy_log.txt';

open my $hin, '<', $filename
    or die "Cannot open file /$filename/";

my @fcont = <$hin>;

my ( $dir, $txt, $nbytes, $file_found, $sav_dir, $sav_file );
foreach my $line (@fcont) {
    if ( $line =~ /New File|New Dir/ ) {
        ($dir)        = $line =~ /New Dir\s+(?:[0-9]+|[0-9]+?\.[0-9]+?
+\s[a-z])\s(.*)/;
        ($file_found) = $line =~ /New File\s+(?:[0-9]+|[0-9]+?\.[0-9]+
+?\s[a-z])\s(.*?)\s+?/;
        ( $txt, $nbytes ) = $line =~ /(New File|New Dir)\s+([0-9]+|[0-
+9]+?\.[0-9]+?\s[a-z])\s.*/;
        $sav_dir  = $dir        if $dir;
        $sav_file = $file_found if $file_found;
        $sav_dir  = !defined $sav_dir  ? q{} : $sav_dir;
        $sav_file = !defined $sav_file ? q{} : $sav_file;
        print join( "\t\t", $txt, $sav_dir, $nbytes, $sav_file ) . "\n
+";
    }
}

close $hin;

[download]

Also look at this example, how to avoid $1, $2, ... matching parameters, you can directly assing the result to a list of variables

You also can try to put the three assignments in ony line, this is left as an exercise ;-)

Replies are listed 'Best First'.
Re^4: Robocopy log parsing
by Anonymous Monk on Jun 01, 2012 at 09:26 UTC

    Thanks alot for this. Works very nicely. There is one thing though. This is tyhe result:

                New Dir                                                   
+                                      16    x:\xxxxxx\xxx\
        New File  x:\xxxxxx\xxx\                                      
+                        126862    xxxxxxxxxxxxxxxxxxxxxxx.xxx
        New File  x:\xxxxxx\xxx\                                      
+                         48640    xxxxxxxxxxxxxxxxxxxxxxxxx.xxx
        New File  x:\xxxxxx\xxx\                                      
+                         96494    xxxxxxxxxxxxxxxxxxxxxx.xxx
        New File  x:\xxxxxx\xxx\                                      
+                        105466    xxxxxxxxxxxxx.xxx
        New File  x:\xxxxxx\xxx\                                      
+                        653655    xxxxxxxxxx.xxx
        New File  x:\xxxxxx\xxx\                                      
+                        542396    123456778910xxxxx.xxx
        New Dir                                                       
+                                   6    y:\yyyyyyyyy\yyyyyyyyyyy\yyyy
+yyy\123456778910xxxxx.xxx
        New File  y:\yyyyyyyyy\yyyyyyyyyyy\yyyyyyy\                   
+        41984    yyyyyyyyyyyyyyyyyy.yyy
        New File  y:\yyyyyyyyy\yyyyyyyyyyy\yyyyyyy\                   
+        10007    yyyyyyyyyyyyyyy.yyy
        New File  y:\yyyyyyyyy\yyyyyyyyyyy\yyyyyyy\                   
+        1.3 m    yyyyyy.yyy

    [download]

    when it encounters the next New Dir entry, it adds the last filename from the previous one. as exampled above. Any suggestions?

[reply]
[d/l]

      Any suggestions?

      Its a classic off-by-one error (OBOE) , it should be simple to fix

[reply]
Re^4: Robocopy log parsing
by bit5nip3r (Initiate) on Jun 01, 2012 at 14:26 UTC

    Thanks. I made a few tweaks, and have also wraped a MySQL import process around it. So now it parses the log file and directly imports into MySQL.

    use warnings;
use strict;
use DBI;

# Set datasource
my $dsn = "DBI:mysql:host=<hostname>;database=<dbname>"
            . ";port=<portnumber>";

# Connect to database 
my $dbh = DBI->connect($dsn,"userid","password");
print "Status: Connected to MySQL.\n";

my $filename = $ARGV[0];

open my $hin, '<', $filename
    or die "Cannot open file /$filename/";

my @fcont = <$hin>;

my ($dir, $txt, $nbytes, $file_found, $sav_dir, $sav_file);

foreach my $line (@fcont) 
{
    if ($line =~ /New File|New Dir/) 
    {
            chomp($line);
        ($dir)        = $line =~ /New Dir\s+(?:[0-9]+|[0-9]+?\.[0-9]+?
+\s[a-z])\s(.*)/;
        ($file_found) = $line =~ /New File\s+(?:[0-9]+|[0-9]+?\.[0-9]+
+?\s[a-z])\s+(.*?$)/;
        ( $txt, $nbytes ) = $line =~ /(New File|New Dir)\s+([0-9]+|[0-
+9]+?\.[0-9]+?\s[a-z])\s+.*?/;
        $sav_dir  = $dir        if $dir;
        $sav_file = $file_found if $file_found;
        $sav_dir  = !defined $sav_dir  ? q{} : $sav_dir;
        $sav_file = !defined $sav_file ? q{} : $sav_file;
        # print join("|", $ARGV[0],$txt,$nbytes,$sav_dir,$file_found).
+ "\n";
        
              my $insert = $dbh->prepare('INSERT INTO <tablename> 
                (File,Type,Size,Dir,Name) 
                    VALUES (?,?,?,?,?)') or die "Prepare failed: " . $
+dbh->errstr(); 
    
          $insert->execute($ARGV[0],$txt,$nbytes,$sav_dir,$file_found)
+ or die "Execute failed: " . $dbh->errstr(); 
    }
}
close $hin;
print "Status: Processing of $ARGV[0] complete.\n";

# Disconnect from the database
$dbh->disconnect ();
print "Status: Disconnected from MySQL.";

    [download]
[reply]
[d/l]

In Section Seekers of Perl Wisdom