comment on

Two days ago, I was having the same issues. My testing script is a bit more elaborate, but confirms your problem: \w does not work under use locale, whatever the locale is. If you need locale, use posix classes or unicode character properties (provided your locale is unicode based).
Discussion on the details can be found in perlunicode and perllocale, but the relevant paragraphs are quite different in each version of Perl.

#!/usr/bin/perl

use warnings;
use strict;

my @p_locale = qw/C cs_CZ.UTF8 en_US.UTF8/;
my @locale = ('no locale', 'use locale');
my @posix  = (q(),
              'use POSIX qw/locale_h/; setlocale LC_ALL,"C"',
              'use POSIX qw/locale_h/; setlocale LC_ALL,"cs_CZ.UTF8"',
             );

for my $p_locale (@p_locale) {
    for my $locale (@locale) {
        for my $posix (@posix) {
            print "$p_locale  $locale  $posix\n";
            open my $OUT, '>', 'l.perl' or die "$!";
            print {$OUT} << "            OUT";
              $locale;
              $posix;
              my \@chars = qw/283 269 345 225
                  32
                  98 99 48 49 50 51 52
                  32
                  353 253 382 237/;
              my \$string = join q[], map chr, \@chars;
              binmode STDOUT, ':utf8';
              my \@regex  = (qr/(\\w+)/, qr/([[:alnum:]]+)/, qr/(\\p{W
+ord}+)/);
              for my \$regex (\@regex) {
                  print "\t\$1" while \$string =~ /\$regex/g;
                  print "\n";
              }
              print sort qw/ci ch/;
              print "\n";
            OUT
            close $OUT;
            $ENV{LC_ALL} = $p_locale;
            system 'perl', 'l.perl';
        }
    }
}
unlink 'l.perl';
[download]

In reply to Re: Regex Matching Unicode and Regex Classes by choroba
in thread Regex Matching Unicode and Regex Classes by McA

Are you posting in the right place? Check out Where do I post X? to know for sure.
Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:
<code> <a> <b> <big> <blockquote> <br /> <dd> <dl> <dt> <em> <font> <h1> <h2> <h3> <h4> <h5> <h6> <hr /> <i> <li> <nbsp> <ol> <p> <small> <strike> <strong> <sub> <sup> <table> <td> <th> <tr> <tt> <u> <ul>
Snippets of code should be wrapped in <code> tags not <pre> tags. In fact, <pre> tags should generally be avoided. If they must be used, extreme care should be taken to ensure that their contents do not have long lines (<70 chars), in order to prevent horizontal scrolling (and possible janitor intervention).
Want more info? How to link or How to display code and escape characters are good places to start.


Just another Perl shrine
	PerlMonks