lc() is rocket fast because this only involves fiddling with one bit within a byte.

That's only true for ASCII. For Unicode, things are quite different and will probably need some kind of table lookup. Just an example for the german language:

Upper Case CharacterCharacter CodeLower Case CharacterCharacter Code
ÄU+00C4äU+00E4
ÖU+00D6öU+00F6
ÜU+00DCüU+00FC
U+1E9EßU+00DF

And unfortunately, that's not all. The LATIN CAPITAL LETTER SHARP S, as ẞ is called in Unicode, is very new. First proposals are about 140 years old, but it became part of the standard german orthography in 2017, after becoming part of Unicode in v5.1.0 (April 2008) and of ISO/IEC 10646 (June 2008).

Before that (i.e. up to 2017), converting LATIN SMALL LETTER SHARP S to upper case resulted in converting it to SS or SZ. And to make things worse, the conversion depends on context. SZ is always ok, but considered harder to read. In general, SS was (and still is) used, except where it may cause misunderstandings. A common example for that problem is "Maße" (dimensions) vs. "Masse" (mass), both can be upper-cased to "MASSE". The meaning can often be derived from the context, to avoid misunderstandings, "Maße" would be upper-cased to "MASZE". Reversing that (i.e. implementing lc()) opens another can of worms, as other words may contain "ss" or "sz" that must not be converted to "ß". The LATIN CAPITAL LETTER SHARP S solves that problem nicely, lc("ẞ") is always "ß", no funny context rules needed.

See also https://en.wikipedia.org/wiki/%C3%9F#Development_of_a_capital_form.

BTW, swiss standard german solved that problem differntly: ß was completely replaced by "ss" in the 20th century (mainly between the 1940s and 1970s). "Maße" vs. "Masse", both written as "Masse", has to be resolved by context.

Alexander

--
Today I will gladly share my knowledge and experience, for there are no sweeter words than "I told you so". ;-)

In reply to Re^9: Problem with regex wildcard operator (.)...? by afoken
in thread Problem with regex wildcard operator (.)...? by sbrothy

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.