Re^2: Converting UTF8 to ANSI

Thank you for your replay.

You are correct, my understanding of the differences between specific encoding form is strictly theoretical and limited at the moment, especially in the perl context (1st time I ever encounter the term BOM).
I hope to learn more about it as soon as I can.

As for what I mean by ANSI, I really don't know.
All I know is what the encoding line says when I "save as" a file with "Notepad" (Win-xp).

Unfortunately I'm currently preoccupied with the fallout of attempting to install File::BOM as you can see here.
Any assistance with this bigger issue will be most appreciated.

Comment on Re^2: Converting UTF8 to ANSI

Replies are listed 'Best First'.
Re^3: Converting UTF8 to ANSI by haukex (Archbishop) on Aug 29, 2017 at 19:45 UTC
You may want to have a look at The Absolute Minimum Every Software Developer Absolutely, Positively Must Know About Unicode and Character Sets (No Excuses!) As for what I mean by ANSI, I really don't know. All I know is what the encoding line says when I "save as" a file with "Notepad" (Win-xp). I suspect that'll be an encoding like the one I mentioned. You could use the other module I showed, Encode::Guess, to try and find out - it's a core module, no installation necessary. Another trick is to use a character that gets encoded differently in different encodings. I like the Euro symbol € (`"\x{20AC}"` in Perl), other than being easy to type on my keyboard, it is: Not representable in ASCII or Latin1 (aka ISO/IEC 8859-1) In Latin-9 (aka ISO/IEC 8859-15) it is the byte `0xA4` In Windows-1252 (aka CP-1252 and sometimes aka "ANSI") it is the byte `0x80` In MacRoman it is the byte `0xDB` (at least Mac OS >=8.5) In UTF-8 it is the bytes `0xE2, 0x82, 0xAC` In UTF-16 it is `0x20AC` - depending on endianness, bytes `0x20, 0xAC` in UTF-16-BE, or `0xAC, 0x20` in UTF-16-LE So try typing "€" into Notepad, saving it, and using a hex editor to get a clue (not a definite answer) as to what encoding it is. Minor updates.	[reply] [d/l] [select]
Re^3: Converting UTF8 to ANSI by AnomalousMonk (Archbishop) on Aug 29, 2017 at 19:10 UTC
As for what I mean by ANSI, I really don't know. Welcome to the wonderful world of character encodings! What you may mean is the ASCII character encoding. This is an old, 7-bit encoding with the most significant bit (bit 7) always 0. One neat thing about the newer UTF-8 encoding (some people say it's the only neat thing) is that all valid ASCII characters are automatically valid UTF-8 characters. Unfortunately, things quickly go to pieces after that; not all valid UTF-8 characters are valid ASCII, and any mapping of UTF-8 to ASCII is totally arbitrary. Oh, well... Give a man a fish: `<%-{-{-{-<`	[reply] [d/l]