What you have written is a robot. It is very bad netiquitte to not look for and respect robots.txt. Any time anyone asks a question where it is clear from their code that they have written a robot that doesn't do this, please make sure to bring up robots.txt, and point to WWW::RobotRules. (Which comes with LWP.)
In reply to Re (tilly) 1: Using LWP::Parallel
by tilly
in thread Using LWP::Parallel
by wilstephens
| For: | Use: | ||
| & | & | ||
| < | < | ||
| > | > | ||
| [ | [ | ||
| ] | ] |