At my previous job, I worked on a Perl project that ran to about 20k lines that we wrote and about 200k lines that we generated from templates, but still needed to edit by hand. This was an interactive program that acted as a network element in testing cellphone base stations.

We had ZERO performance problems from the program. We didn't even try to optimize once. We simply wrote good Perl code and based our performance on how fast we could make changes to the code. (Since we were in a testing group, we had to keep up with the changes in the programs we were testing, as new features were turned on.) We got our turnaround time to under an hour, in most cases.

We also (Thank the Gods!) had no DBI work to speak of, so I can't speak much on that.

Just as a thought, if this program will always be connecting to the same database(s), I would look at something like mod_perl for databases. That way, you could open the connection and keep it open. Then, each Perl program that starts can connect to this process and ask it to do stuff. That should reduce your overhead in DB connections and the like.

------
We are the carpenters and bricklayers of the Information Age.

Don't go borrowing trouble. For programmers, this means Worry only about what you need to implement.

In reply to Re: Sheer Size by dragonchild
in thread Sheer Size by blackjudas

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.