I do most of my HTML parsing with XML::LibXML. It’s not perfect but it has been fine in 100% of my own practical applications for more than a decade so far. See this thread for more on the right and wrong of it: Parsing HTML/XML with Regular Expressions.

A few years ago, I tried to parse HTML (not XHTML, which is XML) from an older site with XML::XPath and it blew up rather impressively. The Web pages I was trying to parse were absolutely not valid XML and I decided to just use HTML::Parser and analyze the parse event stream rather than try to massage the HTML into something resembling XML. Which was annoying, because XPath queries would have made my code much cleaner.

HTML::Parser seems to be far more tolerant of ... stuff ... in its input. I suggested it here because the input is HTML (not XHTML) and the problem does not care about the larger document structure, so a sliding window on the low-level parse events is sufficient. Potentially, this could even deliver better latency, if the problem is or can be a "live" transformation.

Thanks for the link; that is an interesting node. The first thing I thought was "XHTML? So it is guaranteed to be valid XML?" and my first attempt at a solution would probably use XML::XPath.

HTML is not XML, and you cannot parse HTML with an XML parser.

Hi

Hmm, lets see, html libxml, [google://site:perlmonks.org html libxml]

..scanning... 2003 HTML tidy, using XML::LibXML

second check, html twig ... 2004 XML::Twig and HTML Entities

I'm sure a check of the previously linked docs would have revealed the same , xml parsers can read html

Even when I'm confident in my memory, I always check to make sure

You might also want to make an account, so you can edit your posts and fix your typos, like "steaming mode" in the post above.

Thanks , I already have account

xmltwig.org is all about "streaming mode" as a concept (dont load whole document into memory)

XML::LibXML also supports it -- I checked before I posted

Also both documentations mention "stream"

A person can't know/remember everything, thats why we have perlmonks and search

When Duty Calls, real pedants check the fact not just their memories

Thanks , I already have account

Then why do you not use it for posting?

Please stop harassing the anons to login. Everyone knows about your unencrypted passwords. When this site was popular there was no time for this nonsense. Try to focus on the ideas and not the person (or lack thereof).

Then why do you not use it for posting?

Hi,

I'm posting from my account right now