I've had success avoiding script and css data within web pages using HTML::TokeParser as follows: 
# this assumes an html file in @ARGV or on STDIN:

my $src;
{  # read the entire HTML input stream as one contiguous string:
    local $/ = undef;
    $src = <>;
}

my $htm = HTML::TokeParser->new( \$src );

my $inscript = 0;
my $ignore = join '|', qw/script style cssheader/;

while ( my $tkn = $htm->get_token )
{
    if ( $$tkn[0] eq 'S' and $$tkn[1] =~ /^(?:$ignore)$/ )
    {
        $inscript++;   # skip anything having to do with scripts, styl
+es or css
        next;
    }
    elsif ( $$tkn[0] eq 'E' and $$tkn[1] =~ /^(?:$ignore)$/ )
    {
        $inscript--;
        next;
    }
    elsif ( $$tkn[0] eq 'T' and ! $inscript ) {
        # we have text that is not part of scripting or styling,
        # so do something with this text...
    }
}

[download]
This assumes the html input is well formed with respect to script, style and cssheader tags. Note that HTML::TokeParser isn't really any more complicated than HTML::TokeParser::Simple -- you just have to know the structure of the tokens that it returns, so that you can set up handlers for the different types (start tags flagged by  $$tkn[0] eq 'S', end tags by 'E', text data by 'T', etc, with tag name or text content stored in  $$tkn[1]).

In reply to Re: pulling just text from a url by graff
in thread pulling just text from a url by coldfingertips

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.