HTML::TokeParser Search and remove by ID

djlerman has asked for the wisdom of the Perl Monks concerning the following question:

I have come once again seeking perl wisdom

I am using HTML::TokeParser and this is what I would like to do.

Find containing div by ID. Loose everything before that
Find div by ID to be removed. This is within the containing div.
Copy to new string all contents of containing div to new string EXCEPT tags and contents of div by ID to be removed

I have read and searched for a solution, but TokeParser seems complex for my simple understanding.

my $parser = HTML::TokeParser->new(\$content);

while (my $token=$parser->get_tag("div")) {

  if($token->[1]{id} =~ /containerID/i) {
    my $parser1 = HTML::TokeParser->new(\$token->as_is);
    
    while (my $token1=$parser1->get_tag("div")) {
      next if($token1->[1]{id} =~ /removeID/i);
      
      $out = ???;
    }
    
  }
}

var $newContent = "<html><head></head><body>". $out . "</body></head>"
+;
[download]

Comment on HTML::TokeParser Search and remove by ID Download Code

Replies are listed 'Best First'.
Re: HTML::TokeParser Search and remove by ID by Anonymous Monk on Sep 09, 2014 at 21:45 UTC
I am using HTML::TokeParser and this is what I would like to do. Why tokeparser? Its easiest to use HTML::TreeBuilder::XPath or XML::LibXML with tools like xpather.pl/htmltreexpather.pl which can give you paths to start with, and all the links here Re: Retrieve select information from HTML, they're examples(for tree-xpath and others)/walkthroughs/tutorials ... #!/usr/bin/perl -- use strict; use warnings; use Data::Dump qw/ dd /; use HTML::TreeBuilder::XPath; my $tree = HTML::TreeBuilder::XPath->new; $tree->parse_content(<<'__HTML__'); <div id="ro"> <div id="goner"> </div> shambo </div> __HTML__ my( $ro ) = $tree->findnodes( q{ //div[ @id = "ro" ] } ); $ro->detach; $tree->eof; $tree->delete; undef $tree; print "$ro\n"; print $ro->as_HTML, "\n"; $ro->findnodes( q{ //div[ @id = "goner" ] } )->shift->delete; print $ro->as_HTML, "\n"; __END__ HTML::Element=HASH(0xd4dbc4) <div id="ro"><div id="goner"></div> shambo </div> <div id="ro"> shambo </div> [download] *var $newContent =* perlintro, Tutorials► Data Types and Variables More elaborate and coprehensive tutorial in http://learn.perl.org/books/beginning-perl/, Learn Perl in about 2 hours 30 minutes, perlintro, chromatics free book Modern Perl a loose description of how experienced and effective Perl 5 programmers work....You can learn this too.	[reply] [d/l]
Re^2: HTML::TokeParser Search and remove by ID by djlerman (Beadle) on Sep 09, 2014 at 23:00 UTC
Unfortunately we only have HTML::TokeParser installed and will not be able to get another package installed.	[reply]
Re^3: HTML::TokeParser Search and remove by ID by djlerman (Beadle) on Sep 09, 2014 at 23:05 UTC
Sorry, I mean we only have the following installed: /usr/lib/perl5/HTML/PullParser.pm /usr/lib/perl5/HTML/Entities.pm /usr/lib/perl5/HTML/LinkExtor.pm /usr/lib/perl5/HTML/Parser.pm /usr/lib/perl5/HTML/Filter.pm /usr/lib/perl5/HTML/TokeParser.pm /usr/lib/perl5/HTML/HeadParser.pm	[reply]
Re^4: HTML::TokeParser Search and remove by ID by Anonymous Monk on Sep 10, 2014 at 08:42 UTC