The problem is that the current DBD::mysql treats all bind parameters passed in through execute() as strings. That will make all your date arithmetic very very slow. You want to use bind_param() and the SQL types and that should help a bunch. There's a new beta-test version by gmax that will do server-side prepares and that will fix the problem.

  1. Turn AutoCommit off if you are committing in stages.
  2. Use MySQL's multi-value INSERT statement for speed. Even better is to insert your data outside of Perl.
  3. Turn off indices when inserting. An InnoDB FK has an implicit index, so you have the PK index and two other indices on that table.
  4. Don't use a FLOAT for value ... use an INT. That allows MySQL to optimize better.
  5. Have you considered using MySQL's datetime arithmetic and doing seconds comparisons vs. having MySQL attempt to do the string-wise comparisons you're forcing it to?

Update: gmax has humbly informed me that he didn't write the new DBD::mysql that handles server-side prepares. Instead, he has pointed me to New twist for DBD::mysql which is his discussion of the new work.

Being right, does not endow the right to be rude; politeness costs nothing.
Being unknowing, is not the same as being stupid.
Expressing a contrary opinion, whether to the individual or the group, is more often a sign of deeper thought than of cantankerous belligerence.
Do not mistake your goals as the only goals; your opinion as the only opinion; your confidence as correctness. Saying you know better is not the same as explaining you know better.

In reply to Re: DBI performance problem with MySQL by dragonchild
in thread DBI performance problem with MySQL by e2ka

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.