{
    local $^RANT=1;

I don't know of any module called TokeParser.
I am however, very aware of one called HTML::TokeParser.
If that is indeed the module you are referring to, please refer to it by it's name, so people know what you're talking about.
If you try and say use TokeParser;, perl won't understand, so why should we?

}

I will now quote from the HTML::TokeParser documentation:

 $p->get_text( [$endtag] )
     This method returns all text found at the current position. It will
     return a zero length string if the next token is not text. The
     optional $endtag argument specifies that any text occurring before
     the given tag is to be returned. Any entities will be converted to
     their corresponding character.

You can't be shooting in the dark ~ life ain't a mystery, you just have to read the manual ;D

I don't like to speculate about what's happening. I like to know for sure.

Gee, I wonder what'll happen if I execute rm -rf / whilst logged in as root on my linux machine? Hmmmm, should I try it out and then guess what it does? Anybody, anybody? *sigh*

I wonder why people write documentation anymore ....

____________________________________________________
** The Third rule of perl club is a statement of fact: pod is sexy.