Re^4: Remove all non alphanumeric characters excluding space, underscore and minus sign

The docs of Text::Unidecode say: "It often happens that you have non-Roman text data in Unicode" and "If you get really implausible nonsense out of unidecode(...), make sure that the input data really is a utf8 string."

So out of caution I add "use utf8;" to my scripts using Text::Unidecode.

CountZero

A program should be light and agile, its subroutines connected like a string of pearls. The spirit and intent of the program should be retained throughout. There should be neither too little or too much, neither needless loops nor useless variables, neither lack of structure nor overwhelming rigidity." - The Tao of Programming, 4.1 - Geoffrey James

Comment on Re^4: Remove all non alphanumeric characters excluding space, underscore and minus sign Download Code

Replies are listed 'Best First'.
Re^5: Remove all non alphanumeric characters excluding space, underscore and minus sign by BrowserUk (Patriarch) on Feb 13, 2012 at 14:24 UTC
So out of caution I add "use utf8;" to my scripts That doesn't help if the text in question is coming from the keyboard or a ANSI format file source does it? (Hence why I suggested that the OP might need to clarify the source of the data.) With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday' Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error. "Science is about questioning the status quo. Questioning authority". In the absence of evidence, opinion is indistinguishable from prejudice. The start of some sanity?	[reply]
Re^6: Remove all non alphanumeric characters excluding space, underscore and minus sign by CountZero (Bishop) on Feb 13, 2012 at 15:40 UTC
Yes, `use utf8` only makes sure your script is utf-8. External data is anybody's guess what encoding it is. CountZero A program should be light and agile, its subroutines connected like a string of pearls. The spirit and intent of the program should be retained throughout. There should be neither too little or too much, neither needless loops nor useless variables, neither lack of structure nor overwhelming rigidity." - The Tao of Programming, 4.1 - Geoffrey James	[reply] [d/l]