I have to say that, for the most part, it's all relative. It truely depends on
the operations you're doing on the table.

if you have a table with 1.6 million rows and you try and insert to it, you should
see no hit in the speed. I've seen my server hit upwards of 200 inserts per second
with no negative impact.

On the other hand, if you're doing massive select left join on non indexed tables.
You will see it slow down as the size grows. Again though, it's relative. It's still
going to be faster then anything DBD::CSV could do. Though normal basic selects should be ok.

just as an example.

i have one table called "raw_test_results".

It's currently 5.8 gigs of data, and 1.8 gigs of indexs (7.6GB total size).
That's 43,973,656 rows x 36 cols.

I currenty insert to it at 64 inserts per second. However, crunching the numbers
down with a leftjoin takes well over a minute. When the project started it would take well under a second.

In reply to Re: [OT]Efficiency questions on MySQL by jaco
in thread [OT]Efficiency questions on MySQL by kiat

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.