in reply to unix perl web spider

Of course wget -m could do the same thing better (and that's only one 'standard' unix tool).

Peter Stuifzand