Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number
 
PerlMonks  

Re: Use more than one threads for one file processing

by hippo (Bishop)
on Jun 17, 2016 at 08:37 UTC ( [id://1165957]=note: print w/replies, xml ) Need Help??


in reply to Use more than one threads for one file processing

Since I use one thread for 25min to filter one fastq.gz file, I would like to use more than one threads to filter one file in order to speed up the whole process. Is it possible?

Maybe, but that will depend strongly on what "filter" means. If the "filter" is a fairly trivial procedure then likely your process will be IO-bound and multiple threads won't help you. Conversely, if "filter" is CPU intensive and you have multiple cores on the hardware then threads could give an impressive speed-up.

If you don't know how heavy "filter" is, profile it (eg. with Devel::NYTProf).

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://1165957]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others sharing their wisdom with the Monastery: (5)
As of 2024-03-28 13:03 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found