Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister
 
PerlMonks  

Re: Improving SQL speed

by oha (Friar)
on Nov 02, 2009 at 10:22 UTC ( [id://804435]=note: print w/replies, xml ) Need Help??


in reply to Improving SQL speed

as a general rule, you should try to find-out if your script is CPU bound (so there is some algorithms to be checked) or IO bound (waiting for DB to finish or waiting for the HDD). Just check the CPU load or use NYTProf.

Also it seems to me a very scalable task, IOW you can run the script which find all the files to be managed and split this list in lists; then fork as many times for every list and process the data. This will solve latency issues to the db and speed-up the other cases also.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://804435]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others perusing the Monastery: (3)
As of 2024-04-25 12:45 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found