Beefy Boxes and Bandwidth Generously Provided by pair Networks
Syntactic Confectionery Delight
 
PerlMonks  

Re^7: Problem with regex wildcard operator (.)...?

by AnomalousMonk (Bishop)
on Sep 06, 2021 at 08:30 UTC ( #11136499=note: print w/replies, xml ) Need Help??


in reply to Re^6: Problem with regex wildcard operator (.)...?
in thread Problem with regex wildcard operator (.)...?

I prefer ... tr/A-Z/a-z/ ...

So do I - or better yet lc in this case. :)


Give a man a fish:  <%-{-{-{-<

Replies are listed 'Best First'.
Re^8: Problem with regex wildcard operator (.)...?
by Marshall (Canon) on Sep 06, 2021 at 09:02 UTC
    Yes, lc() is rocket fast because this only involves fiddling with one bit within a byte. C and ASM can do this very, very quickly. This is just a minor point in the OP's code. This is in a "run once" initialization loop. No optimization here will make any difference at all in terms of user perceived performance.

    The OP does have a correct idea in that running a regex against all lines of the input dictionary will be so fast, that the complexity of that regex probably makes no difference at all. The idea of throwing away extraneous results that are either too long or too short in terms of number of characters also probably makes no difference.

    I think the problem here is that we do not have clearly defined textual description (meaning something that a human can understand) of what the code is supposed to do! Nobody here can "fix" code that doesn't do what it is supposed to do, if we don't know what it is supposed to do in the first place!

      lc() is rocket fast because this only involves fiddling with one bit within a byte.

      That's only true for ASCII. For Unicode, things are quite different and will probably need some kind of table lookup. Just an example for the german language:

      Upper Case CharacterCharacter CodeLower Case CharacterCharacter Code
      U+00C4U+00E4
      U+00D6U+00F6
      U+00DCU+00FC
      U+1E9EU+00DF

      And unfortunately, that's not all. The LATIN CAPITAL LETTER SHARP S, as ẞ is called in Unicode, is very new. First proposals are about 140 years old, but it became part of the standard german orthography in 2017, after becoming part of Unicode in v5.1.0 (April 2008) and of ISO/IEC 10646 (June 2008).

      Before that (i.e. up to 2017), converting LATIN SMALL LETTER SHARP S to upper case resulted in converting it to SS or SZ. And to make things worse, the conversion depends on context. SZ is always ok, but considered harder to read. In general, SS was (and still is) used, except where it may cause misunderstandings. A common example for that problem is "Mae" (dimensions) vs. "Masse" (mass), both can be upper-cased to "MASSE". The meaning can often be derived from the context, to avoid misunderstandings, "Mae" would be upper-cased to "MASZE". Reversing that (i.e. implementing lc()) opens another can of worms, as other words may contain "ss" or "sz" that must not be converted to "". The LATIN CAPITAL LETTER SHARP S solves that problem nicely, lc("ẞ") is always "", no funny context rules needed.

      See also https://en.wikipedia.org/wiki/%C3%9F#Development_of_a_capital_form.

      BTW, swiss standard german solved that problem differntly: was completely replaced by "ss" in the 20th century (mainly between the 1940s and 1970s). "Mae" vs. "Masse", both written as "Masse", has to be resolved by context.

      Alexander

      --
      Today I will gladly share my knowledge and experience, for there are no sweeter words than "I told you so". ;-)
        Also, to the best of my knowledge, not having a capital ẞ creates another issue because the vowel before a double consonant is pronounced differently than a vowel before a single consonant (short vs long). I don't think that there is any idea of a "spelling bee" in German. For the most part, if you can say a word correctly, you can spell it.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://11136499]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others drinking their drinks and smoking their pipes about the Monastery: (4)
As of 2022-09-29 10:24 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    I prefer my indexes to start at:




    Results (125 votes). Check out past polls.

    Notices?