in reply to Flat File Database

erichansen1836,

Welcome...

Several years ago, I wrote a pure-Perl replacement for BerkeleyDB. My reasons were not about performance, but about licensing fees. Oracle bought SleeyCat and so controlled the licensing. For our clients ( Fortune 1000 companies ) the fees for Oracle's BerkeleyDB were many times the fees for our products.

This doesn't seem to be your problem, but you may want to consider 2 things.

If you are only going to use your product internally and only by you then this isn't a concern. But, if you are going to incorporate this with a commercial product than this will be very important. YMMV.

Our 1st client has a PurePerlDB database of more than 100 million records and has at times more than 1,000 users simultaneously using the data base. Big Data is real today and benchmarks of 10,000 records just don't tell the story.

Good luck, and your not alone!

Regards...Ed

"Well done is better than well said." - Benjamin Franklin

Replies are listed 'Best First'.
Re^2: Joint Database Technology
by locked_user erichansen1836 (Sexton) on Oct 01, 2017 at 17:22 UTC
    Our 1st client has a PurePerlDB database of more than 100 million records and has at times more than 1,000 users simultaneously using the data base. Big Data is real today and benchmarks of 10,000 records just don't tell the story.

    Good luck, and your not alone!

    Regards...Ed

    Ed, thanks for the productive comment. Back 17 years ago, around 2000, I was asked by Bank of America to write an invoice Flat File record editor application in Win32 Perl (with a native Windows, Win32::GUI module user-interface). Back then I had not discovered tandem use of Flat Files with persistent SDBM indexing to the Flat File records. I remember how my application would have to read in the entire Flat File (at launch) and create the indexes in memory each time. This was a bit of a pain for my end-user. Regards...Eric