In reply to Re: web crawler infrastructure by Anonymous Monk in thread web crawler infrastructure by david2008