If there is no archive module that can work on disk rather than all in memory, I might have a go at writing one.

Go for it! Off hand I can't think of anything that can do what you want. Sorry.