in reply to Lexing: how to define tokens based on "context"

open to better names than "LINECONTINUER"...)

MULTIPASS MULTILINE?

Since the rule name can be any alphanumeric string including _ a simple "\w+" won't suffice.

Sure it will :) \w matches  [a-zA-Z0-9_]

...HOP:: ... HOP::...

See simple HOP::Parser usage , this is why I wouldn't recommend HOP -- I can't figure it out :)

See http://jeffreykegler.github.io/Ocean-of-Awareness-blog/metapages/annotated.html#TUTORIAL esp http://marpa-guide.github.io/ and Marpa DSL is EEBNF

Replies are listed 'Best First'.
Re^2: Lexing: how to define tokens based on "context" (Marpa)
by marinersk (Priest) on Oct 17, 2013 at 13:45 UTC
    open to better names than "LINECONTINUER"

    "CONTINUATION_CHARACTER" ?

      APPEND_NEXT?