Having looked at the RecDescent man page just now, I'd say that the use of the "or" conjunction causes the first element (before "|") to be tried first, and the latter to be tried only if the first does not match. In your case, the LITERAL condition matches not only the content between tags, but also everything except the "<" of the tags themselves. When you test for LITERAL first, TAG would never have an oppurtunity to match.

Being less familiar with RecDescent, I thought it might be easy to make a suitable regex for use with split() to get the same result as what you want, but it seems that this alone would not be enough -- you'd have munge the data a little, before or after the split, to get your array. For example, assuming the whole string with tags and content is now in $_ (and hoping there are no "spurious" angle brackets), here's a method that inserts split-able strings around tags to make split produce intended array: 

s/(.)</$1=!=</gs;  # use some distinct pattern to mark open brackets
s/>(?!=!=)/>=!=/g; # and close brackets that aren't adjacent to "<"
@tokens = split( /=!=/ );

[download]
If the string begins with initial "<", the first substitution won't match that, so we won't get an empty (fictitious) first element in @tokens. Likewise, the second substitution makes sure that no empty tokens are generated where the input had "...><..." (nothing between adjacent tags) or a string-final ">".

In reply to Re: Parse::RecDescent by graff
in thread Parse::RecDescent by ixo111

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.