in reply to Spidering websites

...and if you *really* want to do it in perl, then you can check LWP::RobotUA (and the other LWP:: modules), and then do a quick search here in the monastery to find some scripts that might guide you.

hope this helps,

Update: Changed LWP::UserAgent to LWP::RobotUA, thanks belg4mit.

Replies are listed 'Best First'.
Re: Re: Spidering websites
by belg4mit (Prior) on Apr 09, 2002 at 04:15 UTC
    Umm better than that LWP::RobotUA, behave yourself.

    --
    perl -pe "s/\b;([mnst])/'\1/mg"