Repeat after me:

  1. I will not store files inside of the database.
  2. I will not store files inside of the database.
  3. I will not store files inside of the database.
  4. I will not store files inside of the database.
  5. I will not store files inside of the database.
  6. I will not store files inside of the database.
  7. I will not store files inside of the database.
  8. I will not store files inside of the database.

Storing files inside of the database is just a Bad Idea. You are much better off doing something like the following:

  1. Insert a new record into the database (filename, size, source, date, etc).
  2. Get the ID of the new record.
  3. Take the md5 hash signature of the ID + some secret code.
  4. Your hash is something like 0123456789abcdef0123456789abcdef
  5. Update the database record to show "hash = '0123456789abcdef0123456789abcdef'"
  6. Make folder /var/media/01/23/45
  7. Write file contents to /var/media/01/23/45/0123456789abcdef0123456789abcdef

NOTE: /var/media/ could be a local volume or a remote-mounted SAN. You choose.

Now, you can partition the files across multiple servers. You can store the files on a SAN and have (many) dummy file servers in front of it.

This is (basically) how wikimedia does it. And just look at how many files they have. Storing the files inside of the database is just Not How It's Done.

In reply to Re^3: Insert BLOB into DB without using system memory, but using filehandle. by jdrago_999
in thread Insert BLOB into DB without using system memory, but using filehandle. by songahji

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.