I guess you ran into some bug. I'd first check whether it problem still happens in a modern version of Perl (there have
been 3 major releases since 5.004_04). Otherwise, the bug might be in your (POD) code.
I'm a dork, I've been staring at this computer too long. The new output file was getting appended onto an older file. I discovered this after I posted the quetion.