Help for this page

Select Code to Download


  1. or download this
     my $token_grammar = qr {
            
    ...
            <token: punctuation>   ( \.+ | ,+ | ?+ | !+ | "+ | '+ | ;+ | :
    ++ | -+ | &+ | \(+ | \)+ | \[+ | \]+ )
            
        };
    
  2. or download this
     
    my $token_grammar = qr {
            
    ...
            <token: unit>                  <word>
            <token: word>             \b \w+ \b  
    }