in reply to Re: Joint Database Technology
in thread Flat File Database

Acknowledging all of your points, Mariners, here’s a good, every-day example of a distinction that I might draw:   “given the requirement to ‘store large images,’ do you store those images in your RDBMS, or do you instead store filenames?”

There’s no bright-line rule.   It depends on many things, including how well your particular database implementation handles “large BLOBs.”   Also to be considered is the fact that any file-system is also “a database of sorts,” which is extremely adept at storing variable-sized objects using a single key otherwise known as a “file name.”   Both approaches are defensible and we have all seen both of them done.

If the files which contain the data are enormous, and/or if they are already being used for other purposes by other existing applications, then it might well not be appropriate to move these data into an RDBMS, but, instead, to use the RDBMS as an index.   There is still a lot of high-volume data processing which requires the use of sorted files, with sorted updates being applied to those always-sorted remains-sorted files, specifically to avoid random-access.   But an RDBMS might still be useful for quickly and directly finding the location (exact, or approximate) of whatever data is being sought, thereby allowing the records to be queried randomly.   It is an admitted compromise, to be judiciously employed if and when the case arises.

Replies are listed 'Best First'.
Re^3: Joint Database Technology
by marinersk (Priest) on Mar 25, 2015 at 15:39 UTC

    Agreed on all points.

    Man, that's twice in one year. We should check and see if Armaggedon is happening or something.

      Don’t worry, the stars must be out-of-alignment or something . . .

        LOL!

        Truth be known, I tend to have my disagreements with you far more often about the value of dogmatic process than anything else.

        Here, we have an almost purely technical discussion, so it should not be overly surprising that we actually see more eye-to-eye on this one.

Re^3: Joint Database Technology
by Anonymous Monk on Jun 12, 2017 at 17:31 UTC
    In response to "Do you store images in your RDBMS, or do you instead store filenames?” In my tandem: Perl SDBM(random access indexing)/Flat File Databases(text data storage, fixed-length records) I store Bitmaps as text. Then, on the fly, I convert those text representations of images back into real images to display them to the end-user. This is a great security feature. This can be done on Windows O/S systems with Win32 Perl and the InLineBitMap conversion utility that comes with the Win32-GUI module.