I was thinking also to use some database, but this seemed to me too heavyweight for what I wanted to achieve.

I think that anything that's too heavyweight for your filesystem is worth a database. ;-)

But you mentioned you work on Windows. I've no idea what the semantics on Windows are - the sequence of events I envisioned is for Unix. Can you even delete an open file on Windows?