If I save each record in a single Flat File, it would need to be opened, read, and rewritten, which I assume is not the fastest technique.

Well, your solution would require to read directory every 20 seconds, and also you should have a lock file if I understand your problem correctly. If you don't want to install and use database server you can use some file based database like DBD::SQLite or BerkeleyDB.