as a general rule, you should try to find-out if your script is CPU bound (so there is some algorithms to be checked) or IO bound (waiting for DB to finish or waiting for the HDD). Just check the CPU load or use NYTProf.
Also it seems to me a very scalable task, IOW you can run the script which find all the files to be managed and split this list in lists; then fork as many times for every list and process the data. This will solve latency issues to the db and speed-up the other cases also.
-
Are you posting in the right place? Check out Where do I post X? to know for sure.
-
Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:
<code> <a> <b> <big>
<blockquote> <br /> <dd>
<dl> <dt> <em> <font>
<h1> <h2> <h3> <h4>
<h5> <h6> <hr /> <i>
<li> <nbsp> <ol> <p>
<small> <strike> <strong>
<sub> <sup> <table>
<td> <th> <tr> <tt>
<u> <ul>
-
Snippets of code should be wrapped in
<code> tags not
<pre> tags. In fact, <pre>
tags should generally be avoided. If they must
be used, extreme care should be
taken to ensure that their contents do not
have long lines (<70 chars), in order to prevent
horizontal scrolling (and possible janitor
intervention).
-
Want more info? How to link
or How to display code and escape characters
are good places to start.
|