XP is just a number | |
PerlMonks |
Re: Benign Web Minerby grep (Monsignor) |
on Sep 30, 2006 at 20:35 UTC ( [id://575700]=note: print w/replies, xml ) | Need Help?? |
Is there a reason why you are not using a DB (postgreSQL being my pick for the amount of concurrent connections you're using) for a backend? This would alleviate the disk frag problem.
If you wanted to continue using wget then create a separate partition holding the downloaded data temporarily until a writer writes to a DB would work.
In Section
Seekers of Perl Wisdom
|
|