just curious, what happend to the: ... flatfile backup that I put in a year or so because we were losing some emails ... ?

Is that essentially the same as the file you are trying to write out now, except not encrytped?

I think kvale's suggestion of storing each submission to a separate encrypted file and then running and end of day job to join them up and send them will be easiest to implement.