Indeed binmode with the appropriate layer (see PerlIO) or even directly specifying it in open's mode string may well be the best way to go.

I'd also recommend reading this thread in which a similar issue is discussed at length.