Re: Removing unwanted chars from filename.

I would strongly recommend Corion's Text::CleanFragment.

As for your regex, note that [:ascii:] is defined as "Any character in the ASCII character set", and the string you've shown here is entirely ASCII, so your code is "working". Perhaps you meant s/[^[:alnum:]]//g or e.g. s/[^[:alnum:]._-]//g instead? (Update: and though tr/A-Za-z0-9._-//cd should be faster, the above module handles Unicode well, so that's why I'd still recommend that)

Comment on Re: Removing unwanted chars from filename. Select or Download Code

Replies are listed 'Best First'.
Re^2: Removing unwanted chars from filename. by kcott (Archbishop) on Oct 06, 2022 at 22:40 UTC
G'day haukex, "... (Update: and though `tr/A-Za-z0-9._-//cd` should be faster, the above module handles Unicode well, so that's why I'd still recommend that) I wasn't aware that transliteration would have a problem with Unicode. Here's a quick test: $ perl -Mutf8 -E ' my $s = " abc \t ©︎ αβ гдж سشص ᚠᚢᚸ ⎈ ☂ .png"; $s =~ tr/A-Za-z0-9._-//cd; say $s; ' abc.png I'm using Perl v5.36; are there issues with earlier versions? I tested with a fair selection of Unicode characters but, obviously, I can't reasonably test them all. Are there problems with Unicode characters I didn't test? — Ken	[reply] [d/l]
Re^3: Removing unwanted chars from filename. by haukex (Archbishop) on Oct 07, 2022 at 06:02 UTC
I was referring to the fact that the `tr` simply clobbers all Unicode characters, while Text::CleanFragment uses Text::Unidecode to try to turn them into ASCII: use warnings; use strict; use utf8; use Text::CleanFragment; my $s = "Ｈｅｌｌｏ．ｔｘｔ"; print clean_fragment($s), "\n"; # prints "Hello.txt" $s =~ tr/A-Za-z0-9._-//cd; print "<$s>\n"; # prints "<>" ! (I've actually encountered filenames similar to the above in the wild)	[reply] [d/l]
Re^4: Removing unwanted chars from filename. by kcott (Archbishop) on Oct 07, 2022 at 06:29 UTC
Thanks for the clarification. — Ken	[reply]


Don't ask to ask, just ask
	PerlMonks