As one of the resident regexiacs, I'm going to spend a lot of time examining your program.

Just so you know, if I had three strings, $word, $ig_first, and $ig_last, which held the characters for each of those three classes, this is how I would construct a regex to match words from a text stream: 

#!/usr/bin/perl -wl

### this code assumes that there are no characters
### in the "ignore_last" class that AREN'T in the
### "word" class -- it might seem silly that there
### would be, but still, that's how I'm coding this  
  
use strict;
  
my $text_stream = q{foo#&#bar};

my $ig_first = '#'; 
my $ig_last = '';
my $word = 'ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz#';
    
    
my $pre    = length($ig_first) ? qr/[\Q$ig_first\E]*/ : '';
my $post   = length($ig_last)  ? qr/[\Q$ig_last\E]*/  : '';
my $inside = length($ig_last)  ? qr/[\Q$ig_last\E]+/  : '';
my ($match, @words);
      
         
{
  # remove chars from $word that are matched by $post
  my $reg = $word;
  $reg =~ s/$post+//g if $post;
  $reg = qr/[\Q$reg\E]/;
 

  # unroll the loop:
  $match = qr{
    ($pre)        # pre chars (save to $1)

    (             # (save to $2)
      $reg+       # one or more regular chars

      |           # OR

      $reg*       # zero or more regular chars
      (?:
        $inside   # one or more post chars
        $reg+     # one or more non-post chars
      )+          # this chunk one or more times
    )
  }x;             # /x for extended mode
}

    
$text_stream =~ s[$match]{ push @words, $2; "$1<b>$2</b>" }eg;

print $text_stream;
print "words: @words";

[download]
</code>

japhy -- Perl and Regex Hacker

In reply to Re: Optimizing regular expressions by japhy
in thread Optimizing regular expressions by moseley

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.