in reply to unix perl web spider
Of course wget -m could do the same thing better (and that's only one 'standard' unix tool).