It gets the ligature right and has a great motto :) :

MOTTO

The Text::Unidecode motto is:


It's better than nothing!


...in both meanings: 1) seeing the output of unidecode(...) is better than just having all font-unavailable Unicode characters replaced with ``?'''s, or rendered as gibberish; and 2) it's the worst, i.e., there's nothing that Text::Unidecode's algorithm is better than.

---

DWIM is Perl's answer to Gödel

At the end of the day there has to be a lookup. That can be fairly quick using the translation function:

use warnings;
use strict;

my $str = <<'STR';
Les naïfs ægithales hâtifs pondant à Noël où il gèle sont sûrs d'être 
+déçus et
de voir leurs drôles d'œufs abîmés
STR

my %xlateL = (
    a => 'âà',
    c => 'ç',
    e => 'èëéê',
    i => 'ïî',
    o => 'ô',
    u => 'ùû'
    #...
    );

my %xlateU;
$xlateU{uc $_} = uc ($xlateL{$_}) for keys %xlateL; #Generate the uppe
+r case versions

eval "\$str =~ tr/$xlateL{$_}/$_/;" for keys %xlateL;
eval "\$str =~ tr/$xlateU{$_}/$_/;" for keys %xlateU;

print $str;
[download]

Prints:

Les naifs ægithales hatifs pondant a Noel ou il gele sont surs d'etre 
+decus et
de voir leurs droles d'œufs abimes
[download]

Note that æ causes a little grief however. Using a regex rather than the translation and a seperate set of tables is probably the fix for that.

This would make a good CPAN module when you've got it done. :)

I notice Text::StripAccents at least (I didn't find Text::Unaccent using ppm) suffers the æ problem. No great surprise that something written to handle accents doesn't handle ligatures, but somewhat disapointing.

---

DWIM is Perl's answer to Gödel

Text::Unaccent is an XS module and wont build cleanly according to ActiveState.

jdtoronto

# in-place
sub asciiize {
  $_[0] =~ s/([^\0-\x7f])/exists($asciiize{$1})?$asciiize{$1}:"?"/eg;
  return $_[0];
}

# returns new
sub giveascii {
  asciiize(my $x = shift);
}
[download]

Edited by planetscape - added readmore tags