in reply to Using Object::Destroyer with HTML::FormatText

Any help would be greatly appreciated!

And ignored (Re^3: Memory Leak HTML::FormatText)

Here is another idea, keep a database of stuff you've seen (say DB_File or DBD::SQLite ), and every 1000 urls, restart your process, thus avoiding any memory buildup, without fixing any modules

When you've processed all urls, quit

  • Comment on Re: Using Object::Destroyer with HTML::FormatText

Replies are listed 'Best First'.
Re^2: Using Object::Destroyer with HTML::FormatText
by PerlNovice999 (Novice) on Sep 18, 2013 at 09:05 UTC

    Thank you for your reply!

    Yes, I can simply partition the process into batches of less than 3000 files (i.e., before I run out of memory). Instead of using DBD::SQLite or something like this, I can simply do this by creating seperate files with the website addresses. I am not a computer programmer, I am trying to limit the modules I am using since the CPAN documentation is usually not sufficient for me to understand them...

    I did not ignore the node you are referring to. It just did not help me. I tried the delete call (see my response to the earlier node), but that did not work. I do not know what exactly I have to delete and how to do it. I was hoping that Object::Destroyer would take care of this. I just do not understand how it works exactly when combining it with HTML::FormatText

    I am presumably not the only one using HTML::FormatText with a lot of files and/or using Object::Destroyer, so I am hoping that there is a immediate fix to my problem, rather than using some workaround.

[reply]

      I can simply do this by creating seperate files with the website addresses.

      don't do this, your computer won't like it very much, stick with sqlite or AnyDBM_File, which ever is easier for you to understand, FWIW, there is always one module like DB_File that you can use that comes with perl, see AnyDBM_File

      I did not ignore the node you are referring to. It just did not help me.

      Why do you think that is? Can you tell me what I suggested?

      I think I suggested adding some Dumper() statements to see what you're dealing with, but the replies to my node included no Dumper() statements or Dumper() output

      Did you see Re^5: Memory Leak HTML::FormatText? Dumper $content? Read that link I gave you?

      I am presumably not the only one using HTML::FormatText with a lot of files and/or using Object::Destroyer, so I am hoping that there is a immediate fix to my problem, rather than using some workaround.

      Sorry PerlNovice999, if I were going post a complete diagnosis with fix I would have done it already. I tried to provide any help, a way (that I have used, and that you can use) to diagnose (and later fix) the problem :)

      Socratic method

[reply]

In Section Seekers of Perl Wisdom