I don't get it, tokenizer/lexer works, but the parser doesn't ( no parse tree), what am I missing? 

#!/usr/bin/perl --
use strict; use warnings;
use HOP::Parser qw/:all/;
use HOP::Lexer ();
my @tokens = (
    [ 'RO',   qr/ro/i, ],
    [ 'SHAM', qr/sham/i, ],
    [ 'BO',   qr/bo/i, ],
#~     [ 'SPACE',   qr/\s+/i, sub{()}],
);
my $RoShamBo = star(
  alternate(
    lookfor('RO'),
    lookfor('SHAM'),
    lookfor('BO')
  ),
);
my $entire_input = concatenate( $RoShamBo, \&End_of_Input, );
use Data::Dump qw/ dd pp /;

my $lexer = HOP::Lexer::string_lexer( q{ RO SHAM BO }, @tokens );
print "tokenizer/lexer works\n";
while ( my $token = $lexer->() ) {
    dd $token;
}

print "\nbut parser doesn't work\n";
$lexer = HOP::Lexer::string_lexer( q{ RO SHAM BO }, @tokens );
if (my ($result, $remaining_input) = eval { $entire_input->($lexer) } 
+) {
  dd [ results => $result, remainder => $remaining_input ];
} else {
  print "Parse error. $@ ", pp($@), "\n";
}
__END__

tokenizer/lexer works
" "
["RO", "RO"]
" "
["SHAM", "SHAM"]
" "
["BO", "BO"]
" "

but parser doesn't work
Parse error. ARRAY(0xa6b164) ["End of input", sub { ... }]

[download]

In reply to simple HOP::Parser usage by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.