Maybe there is a module that supports reading from archives as a file handle?

I believe the core module IO::Uncompress::Unzip does this, and its objects can be used like filehandles, so I think it'd be fairly transparent.