To find Cyrillic characters

Anonymous Monk has asked for the wisdom of the Perl Monks concerning the following question:

Hi monks, I want to find out cyrillic characters in the file. Cyrillic characters ranges from 0400-04FF. XML file contains tag <cd></cd>. Script should validate that cd element contains only cyrillic characters. If it contains other character set, it should prompt an error. I've tried following code.

use encode;
use Encode::Unicode;
[download]

while($val=~/<cd>(.*?)<\/cd>/gsi){
my $no = decode_utf8($1);
binmode STDOUT, ":utf8";}
[download]

But i do not know how to find the unicode value. Can anyone throw somelight on this? thanks in advance. --c

Comment on To find Cyrillic characters - unicode Select or Download Code

Replies are listed 'Best First'.
Re: To find Cyrillic characters - unicode by Zaxo (Archbishop) on Aug 03, 2007 at 04:53 UTC
The regex unicode block property '\P{InCyrillic}' will get you what you want. You may need to open the file in ':utf8' mode. Isolating your match to particular xml elements will require one of the XML modules. That ought to make the text utf8 by default, but old perls may be idiosyncratic about that. After Compline, Zaxo	[reply]
Re^2: To find Cyrillic characters - unicode by Anonymous Monk on Aug 03, 2007 at 06:53 UTC
Many Thanks!!!!!!!!!!	[reply]
Re: To find Cyrillic characters - unicode by graff (Chancellor) on Aug 03, 2007 at 14:12 UTC
Script should validate that cd element contains only cyrillic characters. If it contains other character set, it should prompt an error. Um... is it okay for text within `<cd>...</cd>` to include spaces, digits, punctuation, etc? These lie outside the Unicode Cyrillic range, but might not be "errors". If the tag really is supposed to contain only Cyrillic letters (no whitespace, digits, etc), then something like `warn "Bad content: $cdstr\n" if ($cdstr =~ /\P{InCyrillic}/);` really is all you need, as Zaxo suggested. Adding more to the "acceptable characters" list is not too complicated (although I did have some trouble with methods that I expected to work based on the perlunicode man page). This seems to work okay for the case where whitespace, digits and punctuation are acceptable along with Cyrillic: `warn "Bad content: $cdstr\n" unless ( $cdstr =~ /^(?:[\s\d\p{Punctuation}]\|\p{Cyrillic})+$/ );` [download] (I had expected that I could put a bunch of "\p{...}" things inside a single `[...]` character class, but that didn't work as expected in 5.8.6 or 5.8.8; I even had trouble defining my own subroutine, along the lines explained in perlunicode, and demonstrated here by japhy -- my subroutine ran, but the results were not as expected. I'll be posting a question/bug report to the perl-unicode mailing list.)	[reply] [d/l] [select]