stan131 has asked for the wisdom of the Perl Monks concerning the following question:

Hello Monks,
I need some direction on how to go about this:

--I have log files on HP-UNIX Servers.
--I need to search these log files for strings e.g ( I provide an input string, it should search for exact match and fetch back 100 lines before and after the match string).
--My perl code needs to run on Windows XP machine. Unix box can be accessed only via SSH.
I need some direction how should I go about doing this?

Thanks,
Stan
  • Comment on SSH to Unix and search files for string

Replies are listed 'Best First'.
Re: SSH to Unix and search files for string
by Corion (Patriarch) on Oct 12, 2009 at 07:07 UTC

    The easy way is to use ssh like a filehandle:

    my $verbose = 1; my $r_cat = 'ssh %s cat "%s" |'; # host, file sub r_open { my ($spec) = @_; my ($host,$file) = split /:/, $spec,2; my $cmd = sprintf $r_cat, $host, $file; print "Opening [$cmd]\n" if $verbose; open my $fh, $cmd or die "Couldn't open remote file: $cmd: $!/$?"; $fh }; my $fh = r_open('user@host:some/file'); while (<$fh>) { chomp; print "I read line '$_'\n"; };

    As a second step, you might want to push some of the filtering steps onto the remote server to reduce the amount of data to be transferred:

    my $verbose = 1; my $r_grep = 'ssh %s grep "%s" "%s" |'; # host, re, file sub r_grep { my ($re,$spec) = @_; my ($host,$file) = split /:/, $spec,2; my $cmd = sprintf $r_cat, $host, $re, $file; print "Opening [$cmd]\n" if $verbose; open my $fh, $cmd or die "Couldn't open remote file: $cmd: $!/$?"; $fh }; my $fh = r_grep( 'foo|bar', 'user@host:/some/other/file' ); while (<$fh>) { chomp; die "Weird line <$_>" unless /foo|bar/; print "Read line [$_]\n"; };

    Update Fixed wrong order of split arguments

      it's probably just a typo in your code, but it's
      my ($host,$file) = split /:/,$spec,2;
      and not:
      my ($host,$file) = split $spec,/:/,2;
      ;-)

      to ask a question is a moment of shame
      to remain ignorant is a lifelong shame

Re: SSH to Unix and search files for string
by mickep76 (Beadle) on Oct 12, 2009 at 08:45 UTC

    I would consider re-using apps already available for this purpose like swatch and logwatch. Also instead of remotely log-in todo the queries I would centralize the logging to one host.

    A good guide can be found at Logging with syslog-ng.

    It might not be what you are looking for, just thought it might help.

Re: SSH to Unix and search files for string
by salva (Canon) on Oct 12, 2009 at 13:37 UTC
    If you have GNU grep command installed in the HP-UX server, you can use the -C option to do what you want:
    $ ssh foo@server /usr/local/bin/grep -C 100 "the string you are lookin +g for" /var/log/whatever
    I don't know if the grep that comes with HP-UX has this functionality... probably not!