Re^6: MozRepl cleanup problem

I managed to make a reduced version of that part of my script, sadly I couldn't manage to reduce it under 50 lines.
Would that be fine for you?

UPDATE: Here is the code and some nicknames to test it:

#!/usr/bin/perl

use strict;
use warnings;

use WWW::Mechanize::Firefox;
use WWW::Mechanize;
use Date::Manip;
use DateTime;

open TXT, "<", "nickname.log";
while(! eof (TXT)){    
    my $nick = <TXT>;
    chomp $nick;
            
    open MATCH, "+<", "match.log";
    
    my $j = 0;
    for $j(0..3){
        
        my ($date) = DateTime->now;
        my ($k) = 0;
        while($k < $j){
            $date = $date->subtract( days => 7);
            $k++;
        }
        $date = $date->ymd;
                        
        my $url = "http://www.quakelive.com/#profile/matches/$nick/$da
+te";
        
        my ($firemech) = WWW::Mechanize::Firefox->new();
        $firemech->get($url);
        die "Cannot connect to $url\n" if !$firemech->success();
                
        my ($retries) = 10;
            while ($retries-- and ! $firemech->is_visible( xpath => '/
+/*[@class="areaMapC"]' )) {
                  sleep 1;
            }
            die "Timeout" unless $retries;

        my ($content) = $firemech->content();

        while(($content =~ /class="areaMapC" id="([^<]+)_([^<]+)_([^<]
++)">/gsi)){
            my ($game) = $1;  my ($longid) = $2;  my ($shortid) = $3;
            my ($matchid) = "$longid/$game/$shortid\n";
            print MATCH $matchid;    
        }
        undef $firemech; undef $content;
        $j++;        
    }
    close MATCH;
}
close TXT;
[download]

Nicknames:

peavey
trajan
komap
bluedawg
donpidon
x9rcist
dom_prova_____
newton
burn
tyryl
st1mz
tomo32
zky
hisarrzulu
_luk__47_
sendhu
joopsta
sand5pid3r
trickle
mikenoid
beg1nner
fladder72
4bsan1ty
daitarn
z0id0uf
amoreno
stuntt
askkk
flyttadig
arcsign
glavic
acid_predator
new_0
jala1
crucci
niko95
deputydawg
optixx
ennesit
martianbuddy
b4r
r1dah
gathion
function9
chup4
poocamshot
shnipzr
heppo
b4byb34r
the_hulk
[download]

Comment on Re^6: MozRepl cleanup problem Select or Download Code

Replies are listed 'Best First'.
Re^7: MozRepl cleanup problem by Corion (Patriarch) on Nov 01, 2010 at 22:45 UTC
It seems that you were fighting two problems. One I can't easily fix - it seems that MozRepl::Client does not like getting instantiated twice. You can fix that by only ever using one instance of WWW::Mechanize::Firefox, outside of your loop. The second problem is that Firefox does not fire the proper events when moving to a new URL, if the new URL only differs in the anchor part from the old URL. I've changed your program to simply do two `->get()` calls, one to `about:blank` to flush the current page, and then one again to the new real URL. I've also removed the `use Date::Manip` statement, as it wasn't used at all. There was `$j` used as a counter but incremented in two places. I've removed the explicit increment. The HTML extraction seemed easier when done using the `->selector()` method of WWW::Mechanize::Firefox. Here is the program that works for me: #!/usr/bin/perl use strict; use warnings; use WWW::Mechanize::Firefox; use WWW::Mechanize; use DateTime; my ($firemech) = WWW::Mechanize::Firefox->new(); my $count; while($count++ < 2){ my $nick = <DATA>; chomp $nick; #my $j = 0; for my $j(0..3){ my ($date) = DateTime->now; my ($k) = 0; while($k < $j){ $date = $date->subtract( days => 7); $k++; } $date = $date->ymd; $firemech->get('about:blank'); my $url = "http://www.quakelive.com/#profile/matches/$nick/$da +te"; $firemech->get($url); die "Cannot connect to $url\n" if !$firemech->success(); my ($retries) = 10; while ($retries-- and ! $firemech->is_visible( xpath => '//*[@ +class="areaMapC"]', all => 1 )) { sleep 1; } die "Timeout" unless $retries; my ($content) = $firemech->content(); while(($content =~ /class="areaMapC" id="([^<]+)_([^<]+)_([^<] ++)">/gsi)){ my ($game) = $1; my ($longid) = $2; my ($shortid) = $3; my ($matchid) = "$longid/$game/$shortid\n"; print $matchid; }; my @areaMapC = $firemech->selector('.areaMapC'); print $_->{id},"\n" for @areaMapC; #$j++; } } undef $firemech; __DATA__ peavey trajan komap bluedawg donpidon x9rcist dom_prova_____ newton burn tyryl st1mz tomo32 zky hisarrzulu _luk__47_ sendhu joopsta sand5pid3r trickle mikenoid beg1nner fladder72 4bsan1ty daitarn z0id0uf amoreno stuntt askkk flyttadig arcsign glavic acid_predator new_0 jala1 crucci niko95 deputydawg optixx ennesit martianbuddy b4r r1dah gathion function9 chup4 poocamshot shnipzr heppo b4byb34r the_hulk [download]	[reply] [d/l] [select]
Re^8: MozRepl cleanup problem by giantpanda (Initiate) on Nov 02, 2010 at 12:42 UTC
Thanks for taking the time to test and correct my script. Unfortunately, this still "crashes" before the desired end. Here are the errors (if it helps, these appeared at the 24th player): command timed-out at /Library/Perl/5.10.0/MozRepl/Client.pm line 186 (in cleanup) Can't call method "cmd" on an undefined value at /Lib +rary/Perl/5.10.0/MozRepl/Client.pm line 186, <MATCH> line 7714 during + global destruction. (in cleanup) Can't call method "cmd" on an undefined value at /Lib +rary/Perl/5.10.0/MozRepl/Client.pm line 186, <MATCH> line 7714 during + global destruction. (in cleanup) Can't call method "cmd" on an undefined value at /Lib +rary/Perl/5.10.0/MozRepl/Client.pm line 186, <MATCH> line 7714 during + global destruction. (in cleanup) Can't call method "execute" on an undefined value at +/Library/Perl/5.10.0/MozRepl.pm line 372, <MATCH> line 7714 during gl +obal destruction. (in cleanup) Can't call method "execute" on an undefined value at +/Library/Perl/5.10.0/MozRepl.pm line 372, <MATCH> line 7714 during gl +obal destruction. (in cleanup) Can't call method "cmd" on an undefined value at /Lib +rary/Perl/5.10.0/MozRepl/Client.pm line 186, <MATCH> line 7714 during + global destruction. (in cleanup) Can't call method "cmd" on an undefined value at /Lib +rary/Perl/5.10.0/MozRepl/Client.pm line 186, <MATCH> line 7714 during + global destruction. (in cleanup) Can't call method "cmd" on an undefined value at /Lib +rary/Perl/5.10.0/MozRepl/Client.pm line 186, <MATCH> line 7714 during + global destruction. (in cleanup) Can't call method "cmd" on an undefined value at /Lib +rary/Perl/5.10.0/MozRepl/Client.pm line 186, <MATCH> line 7714 during + global destruction. (in cleanup) Can't call method "is_debug" on an undefined value at + /Library/Perl/5.10.0/MozRepl/Client.pm line 188, <MATCH> line 7714 d +uring global destruction. (in cleanup) Can't call method "execute" on an undefined value at +/Library/Perl/5.10.0/MozRepl.pm line 372, <MATCH> line 7714 during gl +obal destruction. (in cleanup) Can't call method "cmd" on an undefined value at /Lib +rary/Perl/5.10.0/MozRepl/Client.pm line 186, <MATCH> line 7714 during + global destruction. (in cleanup) Can't call method "is_debug" on an undefined value at + /Library/Perl/5.10.0/MozRepl/Client.pm line 188, <MATCH> line 7714 d +uring global destruction. (in cleanup) Can't call method "execute" on an undefined value at +/Library/Perl/5.10.0/MozRepl.pm line 372, <MATCH> line 7714 during gl +obal destruction. (in cleanup) Can't call method "execute" on an undefined value at +/Library/Perl/5.10.0/MozRepl.pm line 372, <MATCH> line 7714 during gl +obal destruction. (in cleanup) Can't call method "execute" on an undefined value at +/Library/Perl/5.10.0/MozRepl.pm line 372, <MATCH> line 7714 during gl +obal destruction. (in cleanup) Can't call method "execute" on an undefined value at +/Library/Perl/5.10.0/MozRepl.pm line 372, <MATCH> line 7714 during gl +obal destruction. (in cleanup) Can't call method "is_debug" on an undefined value at + /Library/Perl/5.10.0/MozRepl/Client.pm line 188, <MATCH> line 7714 d +uring global destruction. (in cleanup) Can't call method "is_debug" on an undefined value at + /Library/Perl/5.10.0/MozRepl/Client.pm line 188, <MATCH> line 7714 d +uring global destruction. (in cleanup) Can't call method "is_debug" on an undefined value at + /Library/Perl/5.10.0/MozRepl/Client.pm line 188, <MATCH> line 7714 d +uring global destruction. (in cleanup) Can't call method "cmd" on an undefined value at /Lib +rary/Perl/5.10.0/MozRepl/Client.pm line 186, <MATCH> line 7714 during + global destruction. (in cleanup) Can't call method "is_debug" on an undefined value at + /Library/Perl/5.10.0/MozRepl/Client.pm line 188, <MATCH> line 7714 d +uring global destruction. (in cleanup) Can't call method "cmd" on an undefined value at /Lib +rary/Perl/5.10.0/MozRepl/Client.pm line 186, <MATCH> line 7714 during + global destruction. (in cleanup) Can't call method "cmd" on an undefined value at /Lib +rary/Perl/5.10.0/MozRepl/Client.pm line 186, <MATCH> line 7714 during + global destruction. (in cleanup) Can't call method "execute" on an undefined value at +/Library/Perl/5.10.0/MozRepl.pm line 372, <MATCH> line 7714 during gl +obal destruction. (in cleanup) Can't call method "execute" on an undefined value at +/Library/Perl/5.10.0/MozRepl.pm line 372, <MATCH> line 7714 during gl +obal destruction. (in cleanup) Can't call method "cmd" on an undefined value at /Lib +rary/Perl/5.10.0/MozRepl/Client.pm line 186, <MATCH> line 7714 during + global destruction. [download] Even if this still doesn't work as intended, I'm really grateful you are helping me.	[reply] [d/l]
Re^9: MozRepl cleanup problem by Corion (Patriarch) on Nov 02, 2010 at 16:23 UTC
My program does not output these messages. Maybe you're not running a recent version of WWW::Mechanize::Firefox? I test with 0.36, which (naturally) is the latest.	[reply]
Re^10: MozRepl cleanup problem by giantpanda (Initiate) on Nov 02, 2010 at 17:41 UTC
Re^11: MozRepl cleanup problem by Corion (Patriarch) on Nov 02, 2010 at 18:04 UTC
Some notes below your chosen depth have not been shown here