in reply to Some Weird behavior with BerkeleyDB and WWW::Mechanize

My personal experience on Linux and Windows is that pretty bad with WWW::Mechanize as it tends to leak from my pov. How many pages are you looking at? I am downloading between 1500-2000 web pages and the leak was somewhere inside WWW::Mechanize as I did not have the leak after changing the URL class. With the simple UA class there was no leak and I gained a lot of speed by running several UAs in parallel.
  • Comment on Re: Some Weird behavior with BerkeleyDB and WWW::Mechanize

Replies are listed 'Best First'.
Re^2: Some Weird behavior with BerkeleyDB and WWW::Mechanize
by downer (Monk) on Dec 06, 2007 at 13:48 UTC
    I switched to LWP::Simple, and that seems to work no problem. I didnt change anything else, so this behavior remains mysterious.