igoryonya has asked for the wisdom of the Perl Monks concerning the following question:

It contains this string: "структура".

I am lost, can't find how to do it.
I guess, I have to use pack or regex, but I don't know where to start. I don't even know, what this encoding is called, although, I saw it before many times.

UPDATED:

I've figured it out. I realized that those 3 digit sequences are not decimal, but octal, so I've tried: 
my $string = "\321\201\321\202\321\200\321\203\320\272\321\202\321\203
+\321\200\320\260";
$string =~ s/\\([[:digit:]]{3})/sprintf "%c", oct($1)/ge;
print $string;

[download]
And it Worked! :)
  • Comment on How to convert a string like this: "\321\201\321\202\321\200\321\203\320\272\321\202\321\203\321\200\320\260" to a proper utf8?
  • Download Code

Replies are listed 'Best First'.
Re: How to convert a string like this: "\321\201\321\202\321\200\321\203\320\272\321\202\321\203\321\200\320\260" to a proper utf8?
by Ovid (Cardinal) on Apr 28, 2016 at 06:04 UTC

    Take a look at Encode::DoubleEncodedUTF8. The following returns your original string:

    #!/usr/bin/env perl

use 5.18.0;
use warnings;
use utf8::all;

use Encode;
use Encode::DoubleEncodedUTF8;

my $bytes = "\321\201\321\202\321\200\321\203\320\272\321\202\321\203\
+321\200\320\260";

my $fixed = decode( "utf-8-de", $bytes );
say $fixed;

    [download]

    Update: A strong word of caution about the above. Fixing "broken" Unicode data is fraught with error, particularly if you can't guarantee the source of the error. If this bad data is coming from outside your program, then try to contact whoever generates that bad data and see if you can get it fixed there. Otherwise, you may have to trust yourself to be lucky on this.

    However, if the bad data is being generated from within your program, try to fix the underlying bug before you try to "fix" the bad strings in question. It will save you much grief in the long run.

    Cheers,
    Ovid

    Hire me for training or software development.

[reply]
[d/l]
      The output comes from 'git status' command.
      I have some filenames in Russian in my project folder.
      The surprising thing is that git shows all other Russian text correctly, only file names appear encoded.
      I've already seek for answers on git's irc chanel. Nobody could help me there.
      Searched on the internet, but the closest thing that I've found about this issue, is a 2 year old similar to mine question, unresolved.
      So, I thought, that, since the git's community can't help me, I will just write an output reformatter. Something, like this: 
      git status -s|perl -nle 's/\\([[:digit:]]{3})/sprintf "%c", oct($1)/ge
+; print'

      [download]
      After seeing, that it works, I've moved perl oneliner to a file, so, now I do: 
      git status -s|oct2char.pl

      [download]
[reply]
[d/l]
[select]
        I believe the quoting can be disabled with core.quotepath option. See man git-config for details.

        Also, that reminds me of... :)

[reply]
[d/l]
[select]

Back to Seekers of Perl Wisdom