Having no experience with this, I thought I would explore a bit. So I did the following: #!/usr/bin/perl
use strict;
use warnings;
use open IO => ':utf8';
while(<DATA>) {
chomp;
(my $nonenglish = $_) =~ s/[A-Za-z]//g;
my @chars = split(//,$nonenglish);
my $chars = scalar(@chars);
print scalar(@chars), " $nonenglish\n";
}
__DATA__
æ
æð
æða
æðaber
æðahnútur
æðakölkun
æðardúnn
æðarfugl
æðarkolla
æðarkóngur
æðarvarp
æði
æðimargur
æðisgenginn
æðiskast
æðislegur
æðrast
æðri
æðrulaus
æðruleysi
æðruorð
æðrutónn
æðstur
æður
æfa
__END__
Seems split sees those letters as two chars also, which makes sense now that I think of it... . Guess I have some things to learn about UTF8!
Thanks for the opportunity! Sorry this is not all that helpful. Suppose one could take the character count and just divide by two ...
$chars = $chars / 2;
print "$chars $nonenglish\n";
...
Update: Might also take a look at CPAN Test UTF8 and related...
...the majority is always wrong, and always the last to know about it...Insanity: Doing the same thing over and over again and expecting different results...
-
Are you posting in the right place? Check out Where do I post X? to know for sure.
-
Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:
<code> <a> <b> <big>
<blockquote> <br /> <dd>
<dl> <dt> <em> <font>
<h1> <h2> <h3> <h4>
<h5> <h6> <hr /> <i>
<li> <nbsp> <ol> <p>
<small> <strike> <strong>
<sub> <sup> <table>
<td> <th> <tr> <tt>
<u> <ul>
-
Snippets of code should be wrapped in
<code> tags not
<pre> tags. In fact, <pre>
tags should generally be avoided. If they must
be used, extreme care should be
taken to ensure that their contents do not
have long lines (<70 chars), in order to prevent
horizontal scrolling (and possible janitor
intervention).
-
Want more info? How to link
or How to display code and escape characters
are good places to start.
|