in reply to Weird file type problems transferring from Windows to Mac OS

You did not give enough information. Running your data through file: 
echo '0000000 ff fe 3d 00 20 00 70 00 61 00 67 00 65 00 20 00
0000010 31 00 20 00 3d 00 0a 00 0d 00 0d 00 0a 00' | xxd -r | file -

[download]

Output: 

Little-endian UTF-16 Unicode text, with CR, LF line terminators

[download]

Can you try removing characters from the end of a misbehaving file until it becomes "text", then post the offending character?

لսႽ† ᥲᥒ⚪⟊Ⴙᘓᖇ Ꮅᘓᖇ⎱ Ⴙᥲ𝇋ƙᘓᖇ

Replies are listed 'Best First'.
Re^2: Weird file type problems transferring from Windows to Mac OS
by Corion (Patriarch) on May 28, 2013 at 14:09 UTC

    I would assume that the file starts with an UTF-BOM:

    ff fe .. ..

    [download]

    Maybe just removing the first two characters "fixes" things, or alternatively BOM, and Encode...

[reply]
[d/l]
      Thanks, but I already checked that. There are files with BOM that are processed with no problem ...
[reply]
Re^2: Weird file type problems transferring from Windows to Mac OS
by agaved (Novice) on May 28, 2013 at 14:42 UTC
    Choroba

    Thanks for the debugging tip.

    Running hexdump -n NNN BAD.txt | xxd -r | file -, with NNN up to 1506 the result is text, at 1508 gives data.

    Running hexdump -n 1520 BAD.txt I get: 
    0000500 55 00 c7 00 c3 00 4f 00 20 00 2e 00 2e 00 2e 00
0000510 2e 00 2e 00 2e 00 2e 00 2e 00 2e 00 2e 00 2e 00
*
00005e0 2e 00 20 00 34 00 20 00 20 00 0d 00 0a 00 32 00
00005f0

    [download]

    strange that the weird character appears before 1508, though ...

[reply]
[d/l]
[select]

      Try using iconv instead of dos2unix to convert the Unicode character encoding scheme of the files. The gremlins in the text might be something like improperly unpaired UTF-16 surrogate characters. I would expect iconv to handle these anomalies better than dos2unix. (It should at least warn you about them in the default case.)

      Just a thought…

      UPDATE: Another good tool for diagnosing peculiar and elusive character encoding problems is BabelPad.

[reply]
        BabelPad is for Windows only, unfortunately ...
[reply]

In Section Seekers of Perl Wisdom