1. You don't need anything extra special to read 1MB chunks of a file at a time, the read function can do that quite easily.
  2. If you use placeholders in your SQL (and you always always always should whenever possible), you never have to worry about special/dangerous characters in the data you're inserting into the DB.

Here's a little demo that reads 1MB at a time, and inserts it into the DB using placeholders. 

open my $fh, 'big-binary-data.file'
    or die "Couldn't open file: $!";

# prepares an SQL statement with data to be filled in later
my $sql = "insert into table set chunk_num=?, data=?";
my $sth = $dbh->prepare($sql) or die "Couldn't prepare sql statement: 
+$!";

my $chunk_num = 0;
my $chunk_size = 1024 * 1024;

while ( read( $fh, my $buffer, $chunk_size ) ) {
  $chunk_num++;

  # executes the statement with the appropriate data filled in
  $sth->execute( $chunk_num, $buffer )
    or die "Couldn't insert data: $!";
}

$sth->finish;

[download]
This should give you a decent starting place. I highly recommend reading the database tutorials here on PM (as well as the DBI documentation) if you're a little unsure of what placeholders do. After understanding them, you will quickly realize their usefulness.

blokhead

In reply to Re: Inserting binary data into MySQL by blokhead
in thread Inserting binary data into MySQL by markolus

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.