Re^4: Malformed UTF-8 character

Thanks for the reminder to check Strawberry (and perl) utilities occasionally.

Note: The character in question (\x96) is one of the differences between ISO-8859-1 and CP1252. See the difference in the character starting at location 12. The savedfile is from the original post Regex: matching any Number then a hyphen.

C:\Users\Bill\forums\monks>xxd savedfile
00000000: 3132 3334 202d 2046 6f6f 0d0a 3536 3737  1234 - Foo..5677
00000010: 3820 9620 4261 720d 0a39 3939 392e 2042  8 . Bar..9999. B
00000020: 617a 0d0a                                az..

C:\Users\Bill\forums\monks>iconv -f ISO-8859-1 -t utf-8 savedfile > ou
+tfile.txt

C:\Users\Bill\forums\monks>xxd outfile.txt
00000000: 3132 3334 202d 2046 6f6f 0d0a 3536 3737  1234 - Foo..5677
00000010: 3820 c296 2042 6172 0d0a 3939 3939 2e20  8 .. Bar..9999.
00000020: 4261 7a0d 0a                             Baz..

C:\Users\Bill\forums\monks>iconv -f CP1252 -t utf-8 savedfile > outfil
+e.txt

C:\Users\Bill\forums\monks>xxd outfile.txt
00000000: 3132 3334 202d 2046 6f6f 0d0a 3536 3737  1234 - Foo..5677
00000010: 3820 e280 9320 4261 720d 0a39 3939 392e  8 ... Bar..9999.
00000020: 2042 617a 0d0a                            Baz..
[download]

Life was so much easier fifty years ago. Oh, there really were two keypunch codes.

Bill

Comment on Re^4: Malformed UTF-8 character Download Code

Replies are listed 'Best First'.
Re^5: Malformed UTF-8 character by choroba (Cardinal) on Dec 02, 2022 at 23:22 UTC
> Life was so much easier fifty years ago If your native tongue didn't look like "šířící žďáření"... `map{substr$_->[0],$_->[1]\|\|0,1}[\\|\|{},3],[[]],[ref qr-1,-,-1],[{}],[sub{}^ARGV,3]`	[reply] [d/l]


laziness, impatience, and hubris
	PerlMonks