in reply to Re^17: Monitor list of threads running
in thread Monitor list of threads running

Thant worked. Thanks.

On another note: I will have lots of threads downloading files using Net::FTP, I have noted the each threads uses 10MB size, Can you tell If I even need 10MB per stack size per thread if all I'm doing is downloading files. Max file size will be 1MB.

Replies are listed 'Best First'.
Re^19: Monitor list of threads running
by BrowserUk (Patriarch) on Apr 09, 2010 at 18:27 UTC
    : I will have lots of threads downloading files using Net::FTP,

    There is a limit to how much benefit you can derive from running downloads concurrently. Namely, the bandwidth of your internet connection. Even if you're sitting on the end of a very fat pipe downloading from independant, throttling servers, I'd seriously doubt you'll see much improvement beyond low 10s of threads. Unless all the servers are on a local Gigabit network.

    Not all of the per-thread memory allocation is stack. Most of it is cloned internal datastructures that you cannot do much about.

    You could try playing with the stack size per the documentation and see what if any difference it makes:

    use threads ('stack_size' => VALUE);

    This sets the default per-thread stack size at the start of the application.

    Perl doesn't use the (C) stack for much. Especially since the regex engine was change from recursive to iterative.

    Personally, I modify the header of my perl executables to reduce the per-thread stack allocation to a minimum (4k), and I've never encountered a problem with this. I don't know if this is possible with *nix executables.


    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.
      Yes, I am working with Gigabit Network.

      so do you set your threads to $old_size = threads->set_stack_size(4096);?

        do you set your threads to $old_size = threads->set_stack_size(4096);?

        Effectively yes. Though I do it in a different way. My advice to you would be to use:

        use threads ('stack_size' => 64 * 1024 );

        Doing it this way means you only need to do it once at the top of your program.


        Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
        "Science is about questioning the status quo. Questioning authority".
        In the absence of evidence, opinion is indistinguishable from prejudice.