Do I need to binmode this somehow?

The documentation says the temp file is already being opened in binary mode, so theoretically, there should be no need to binmode it yourself.  You can of course still try it, though... (just say binmode $tmp; before printing to it.)  Ditto for the file handle $rh that you're reading from.