in reply to HTTP Daemonology

A few ideas:

Replies are listed 'Best First'.
Re: Re: HTTP Daemonology
by jlongino (Parson) on Aug 09, 2001 at 09:39 UTC
    Thanks for the recommendation. I had already implemented the program using top, but then rewrote it using
    ps -efo pid,pcpu,fname as you suggested (and then internally grepped out the ns-httpd). It was a bit easier, but more important, it doesn't require a non-OS application being installed.

    Now that the short-term annoyance is out of the way, I can concentrate some of the other excellent suggestions that require lengthier investigation.

    Thanks everyone for the input.

[reply]
[d/l]
[select]
Re: Re: HTTP Daemonology
by clearcache (Beadle) on Aug 10, 2001 at 20:39 UTC
    Scraping top tough?

    #! /bin/perl -w

use strict;

my @toplines = `echo q | top`;
my $ok = 0;
for (@toplines) {
  next unless /\w/;
  chomp;
  if (/PID/) {
    $ok++;
    next;
  }
  if ($ok) {
    my($PID,$USERNAME,$THR,$PRI,$NICE,
       $SIZE,$RES,$STATE,$TIME,$CPU,$COMMAND) = split;
    print "$PID $CPU $COMMAND\n";
  }
}

    [download]


    I know I know your ps solution is great, too ;) I just wanted to show a relatively painless way to scrape top...
[reply]
[d/l]
Re: Re: HTTP Daemonology
by jlongino (Parson) on Aug 11, 2001 at 06:40 UTC
    For those interested, here is a snippet of the ps variation I ended up using: 
    #!/usr/local/bin/perl
use strict;

my ($ct, $pcpu, $pname, $i, @outrecs, @matches, $process);
my $MaxUtil = 70;
my $sttotal = 0;
my $ct = 0;
foreach $i (1..5) {
   @outrecs = `ps -efo pid,pcpu,fname`;
   @matches = grep /ns-httpd/, @outrecs;
   ## Note: can have more than one ns-httpd running
   ##       but we'll average it in as well
   foreach (@matches) {
      $ct++;
      chomp;
      ($process, $pcpu, $pname) = split(" ");
      $sttotal = $sttotal + $pcpu;
   }
   sleep(3);
}

my $pcpuavg = $sttotal / $ct;

    [download]
    The generated log file provides interesting data but I haven't actually been able to make a correlation between the restart time periods and the access or error logs: 
     PID   TIME                        CPU% NAME
  5257 Wed Aug  8 23:47:07 2001    2.88 ns-httpd
  5257 Wed Aug  8 23:49:09 2001    2.84 ns-httpd
  5257 Thu Aug  9 00:00:16 2001    4.10 ns-httpd
  5257 Thu Aug  9 00:30:16 2001    1.98 ns-httpd
  5257 Thu Aug  9 01:00:15 2001    4.16 ns-httpd
  5257 Thu Aug  9 01:30:15 2001    2.46 ns-httpd
  5257 Thu Aug  9 02:00:16 2001    1.00 ns-httpd
  5257 Thu Aug  9 02:30:16 2001    0.70 ns-httpd
  5257 Thu Aug  9 03:00:17 2001    1.28 ns-httpd
  5257 Thu Aug  9 03:30:16 2001    0.86 ns-httpd
  5257 Thu Aug  9 04:00:17 2001    1.52 ns-httpd
  5257 Thu Aug  9 04:30:16 2001    0.90 ns-httpd
  5257 Thu Aug  9 05:00:16 2001   87.10 ns-httpd

# Avg. Utilization:    87.10% higher than 70%.
# Thu Aug  9 05:00:28 2001 www server restarted.

 PID   TIME                        CPU% NAME
 10158 Thu Aug  9 05:30:15 2001    0.34 ns-httpd
 10158 Thu Aug  9 06:00:16 2001    2.66 ns-httpd
 10158 Thu Aug  9 06:30:15 2001    0.52 ns-httpd
 10158 Thu Aug  9 07:00:16 2001   86.20 ns-httpd

# Avg. Utilization:    86.20% higher than 70%.
# Thu Aug  9 07:00:25 2001 www server restarted.

 PID   TIME                        CPU% NAME
 11405 Thu Aug  9 07:30:15 2001    4.92 ns-httpd
 11405 Thu Aug  9 08:00:16 2001    6.60 ns-httpd
 16991 Thu Aug  9 08:30:16 2001   14.48 ns-httpd
 11405 Thu Aug  9 09:00:19 2001   12.51 ns-httpd
 11405 Thu Aug  9 09:30:16 2001   14.30 ns-httpd
 11405 Thu Aug  9 10:00:16 2001   17.70 ns-httpd
 11405 Thu Aug  9 10:30:16 2001   18.10 ns-httpd
 11405 Thu Aug  9 11:00:16 2001   15.18 ns-httpd
 11405 Thu Aug  9 11:30:16 2001   22.18 ns-httpd
 11658 Thu Aug  9 12:00:17 2001   17.62 ns-httpd
 11405 Thu Aug  9 12:30:16 2001   13.72 ns-httpd
 11405 Thu Aug  9 13:00:16 2001   18.22 ns-httpd
 11405 Thu Aug  9 13:30:16 2001   14.30 ns-httpd
 11405 Thu Aug  9 14:00:16 2001   15.08 ns-httpd
 11405 Thu Aug  9 14:30:16 2001   14.62 ns-httpd
 11405 Thu Aug  9 15:00:16 2001   14.18 ns-httpd
 11405 Thu Aug  9 15:30:16 2001   10.04 ns-httpd
 11405 Thu Aug  9 16:00:16 2001   13.34 ns-httpd
 11405 Thu Aug  9 16:30:16 2001   16.72 ns-httpd
 11405 Thu Aug  9 17:00:16 2001   11.86 ns-httpd
 11405 Thu Aug  9 17:30:16 2001    8.84 ns-httpd
 11405 Thu Aug  9 18:00:16 2001    5.76 ns-httpd
 11405 Thu Aug  9 18:30:16 2001    8.26 ns-httpd
 11405 Thu Aug  9 19:00:16 2001    7.68 ns-httpd
 11405 Thu Aug  9 19:30:16 2001    4.64 ns-httpd
 11405 Thu Aug  9 20:00:16 2001    3.44 ns-httpd
 11405 Thu Aug  9 20:30:16 2001   10.34 ns-httpd
 11405 Thu Aug  9 21:00:16 2001    4.92 ns-httpd
 11405 Thu Aug  9 21:30:16 2001    8.28 ns-httpd
 11405 Thu Aug  9 22:00:16 2001    4.92 ns-httpd
 11405 Thu Aug  9 22:30:16 2001    3.32 ns-httpd
 11405 Thu Aug  9 23:00:16 2001    3.06 ns-httpd
 11405 Thu Aug  9 23:30:16 2001    3.12 ns-httpd
 11405 Fri Aug 10 00:00:16 2001    4.20 ns-httpd
 11405 Fri Aug 10 00:30:15 2001    3.20 ns-httpd
 11405 Fri Aug 10 01:00:16 2001    2.34 ns-httpd
 11405 Fri Aug 10 01:30:16 2001    4.72 ns-httpd
 11405 Fri Aug 10 02:00:16 2001    0.60 ns-httpd
 11405 Fri Aug 10 02:30:16 2001    1.26 ns-httpd
 11405 Fri Aug 10 03:00:17 2001   85.22 ns-httpd

# Avg. Utilization:    85.22% higher than 70%.
# Fri Aug 10 03:00:29 2001 www server restarted.

 PID   TIME                        CPU% NAME
  4859 Fri Aug 10 03:30:17 2001    1.42 ns-httpd
  4859 Fri Aug 10 04:00:17 2001    0.38 ns-httpd
  4859 Fri Aug 10 04:30:15 2001    0.16 ns-httpd
  4859 Fri Aug 10 05:00:16 2001    0.34 ns-httpd
  4859 Fri Aug 10 05:30:16 2001    0.22 ns-httpd
  4859 Fri Aug 10 06:00:16 2001    0.44 ns-httpd
  4859 Fri Aug 10 06:30:16 2001    0.54 ns-httpd
  4859 Fri Aug 10 07:00:16 2001    3.52 ns-httpd
  4859 Fri Aug 10 07:30:15 2001    2.14 ns-httpd
  4859 Fri Aug 10 08:00:16 2001    4.74 ns-httpd
  4859 Fri Aug 10 08:30:16 2001   14.14 ns-httpd
  4859 Fri Aug 10 09:00:17 2001    7.65 ns-httpd
  4859 Fri Aug 10 09:30:16 2001   14.46 ns-httpd
  4859 Fri Aug 10 10:00:16 2001   14.40 ns-httpd
  4859 Fri Aug 10 10:30:16 2001    7.67 ns-httpd
  4859 Fri Aug 10 11:00:16 2001   11.72 ns-httpd
  4859 Fri Aug 10 11:30:15 2001   14.84 ns-httpd
  4859 Fri Aug 10 12:00:16 2001   12.70 ns-httpd
  4859 Fri Aug 10 12:30:16 2001   10.70 ns-httpd
  4859 Fri Aug 10 13:00:17 2001   75.44 ns-httpd

# Avg. Utilization:    75.44% higher than 70%.
# Fri Aug 10 13:00:28 2001 www server restarted.

 PID   TIME                        CPU% NAME
 10115 Fri Aug 10 13:30:16 2001   13.78 ns-httpd
 10115 Fri Aug 10 14:00:16 2001   10.00 ns-httpd
 10115 Fri Aug 10 14:30:16 2001    6.76 ns-httpd
 10115 Fri Aug 10 15:00:16 2001    9.42 ns-httpd
 10115 Fri Aug 10 15:30:16 2001   82.92 ns-httpd

# Avg. Utilization:    82.92% higher than 70%.
# Fri Aug 10 15:30:27 2001 www server restarted.

 PID   TIME                        CPU% NAME
 27219 Fri Aug 10 16:00:16 2001   14.63 ns-httpd
 27219 Fri Aug 10 16:30:15 2001   11.72 ns-httpd
 27219 Fri Aug 10 17:00:16 2001    7.20 ns-httpd
 27219 Fri Aug 10 17:30:16 2001    5.38 ns-httpd
 27219 Fri Aug 10 18:00:16 2001    2.98 ns-httpd
 27219 Fri Aug 10 18:30:16 2001    6.62 ns-httpd
 27219 Fri Aug 10 19:00:22 2001   74.63 ns-httpd

# Avg. Utilization:    74.63% higher than 70%.
# Fri Aug 10 19:00:36 2001 www server restarted.

 PID   TIME                        CPU% NAME
 10103 Fri Aug 10 19:30:16 2001    4.70 ns-httpd
 10103 Fri Aug 10 20:00:17 2001    3.77 ns-httpd
 10103 Fri Aug 10 20:30:16 2001    4.94 ns-httpd
 10103 Fri Aug 10 21:00:16 2001    2.78 ns-httpd

    [download]
    Note: I am still investigating the other suggestions.
[reply]
[d/l]
[select]

In Section Seekers of Perl Wisdom