"So SQLite seems a non-starter. Really? I don't understand that conclusion. Normally converting from MySQL on your laptop to SQLite on an SBC would be a good approach.

This among other things gets rid of username/password issues and other admin problems. A short script to import a fixed-width file doesn't sound like any big deal. Most SQLite utilities import .csv files. One approach would be a simple filter to make your fixed width input file into a .csv file. And then use an import tool on that file. Another approach is shown here: import-fixed-width-text-file-into-sqlite.

As long as the SQL features being used in the MySQL program are available in SQLite, SQLite should provide a smaller footprint solution and work very well.

Update:
You say that this file is an industry standard fixed width format. Ok show say 3 lines of data, some spec on what the columns should be named - maybe schema from your MySQL DB? We could help you with the code to import that data if you are having trouble doing that. If speed matters, the main thing for import is to minimize the number of transactions. I usually run 150K-250K rows per transaction although even a million is fine. There may be some datatype issues in the port (like datetime type) but there are solutions to all of those things. You will be impressed with SQLite performance.

In reply to Re: Perl DBI for MariaDB v SQLite in a Single Use SBC by Marshall
in thread Perl DBI for MariaDB v SQLite in a Single Use SBC by justin423

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.