in reply to PERL UNIX and strangeness and char conversion

The file doesn't contain <93> or \x{93}; it contains a byte with a value of 0x93. This is garbage (where found) when UTF-8 is expected. The two programs simply handle this garbage differently.


What you have is probably a file encoded using cp1252 rather than UTF-8. «“» and «”» are encoded as 93 and 94 respectively when using cp1252.

Convert the file's encoding from cp1252 to UTF-8 before using it with tools expecting UTF-8.

iconv -f cp1252 -t UTF-8 file.cp1252 >file.utf8