delete duplicated xml lines

cibiena has asked for the wisdom of the Perl Monks concerning the following question:

Hi Monks, With xml:libxml and Spreadsheet::ParseExcel and the command " $materialmapping_table_xml->createElement("item"); " I generate lines from excel document. for example:

 
<item pr_1="a" pr_2="2" internal="co_1" pr_family="2" />
<item pr_1="b" pr_2="2" internal="co_1" pr_family="2" />
<item pr_1="c" pr_2="2" internal="co_1" pr_family="2" />
<item pr_1="a" pr_2="1" internal="co_1" pr_family="2" />
<item pr_1="b" pr_2="1" internal="co_1" pr_family="2" />
<item pr_1="c" pr_2="1" internal="co_1" pr_family="2" />
<item pr_1="a" pr_2="2" internal="co_1" pr_family="2" />
<item pr_1="b" pr_2="2" internal="co_1" pr_family="2" />
<item pr_1="c" pr_2="2" internal="co_1" pr_family="2" />
[download]

How I can delte the duplicated xml lines (the first 3 and the last 3 in example)?? output must be:

<item pr_1="a" pr_2="2" internal="co_1" pr_family="2" />
<item pr_1="b" pr_2="2" internal="co_1" pr_family="2" />
<item pr_1="c" pr_2="2" internal="co_1" pr_family="2" />
<item pr_1="a" pr_2="1" internal="co_1" pr_family="2" />
<item pr_1="b" pr_2="1" internal="co_1" pr_family="2" />
<item pr_1="c" pr_2="1" internal="co_1" pr_family="2" />
[download]

thanks

Comment on delete duplicated xml lines Select or Download Code

Replies are listed 'Best First'.
Re: delete duplicated xml lines by hbm (Hermit) on Aug 08, 2012 at 18:49 UTC
I imagine you don't want to delete duplicate lines, you want to avoid creating them. As you walk through your spreadsheet, create an XML line only if the current line hasn't already been seen; and then hash the current line so it won't be duplicated. Something like: `my %seen; for my $thing ($worksheet->...) { next if exists $seen{$thing}; # create XML element $seen{$thing}++; }` [download]	[reply] [d/l]
Re^2: delete duplicated xml lines by cibiena (Initiate) on Aug 09, 2012 at 17:43 UTC
Thankyou very much for your answer, but sorry I'am novice in perl and is very difficult for me. this is a little part of my code: my $materialmapping_table_xml = XML::LibXML->createDocument( "1.0", "U +TF-8"); my $materialmapping_table_xml_root = $materialmapping_table_xml->creat +eElement("masterdata"); $materialmapping_table_xml->setDocumentElement($materialmapping_table_ +xml_root); my $materialmapping_item3 = $materialmapping_table_xml->createElement( +"item3"); $materialmapping_item3->setAttribute(decode('cp1252',$pr_cell_name3->{ +Val}),$pr3); $materialmapping_item3->setAttribute("pr_family",$family); $materialmapping_table_xml_root->addChild($materialmapping_item3); [download] and the same for item2... for example, generate this output: <item2 duble="1" pr="c" pr_width="1250" pr_family="2" /> <item2 duble="2" pr="c" pr_width="1250" pr_family="2" /> <item2 pr="a" duble="2" pr_width="1250" pr_family="2" /> <item2 pr="b" duble="2" pr_width="1250" pr_family="2" /> <item2 pr="c" duble="2" pr_width="1250" pr_family="2" /> <item3 pr="a" duble="1" pr_width="1250" pr_family="2" /> <item3 pr="b" duble="1" pr_width="1250" pr_family="2" /> <item3 pr="c" duble="1" pr_width="1250" pr_family="2" /> <item3 pr_width="1250" duble="1" pr="c" pr_family="2" /> <item3 pr="a" duble="2" pr_width="1250" pr_family="2" /> <item3 pr="b" duble="2" pr_width="1250" pr_family="2" /> <item3 pr="c" duble="2" pr_width="1250" pr_family="2" /> <item3 pr_width="1250" duble="2" pr="c" pr_family="2" /> <item3 pr_width="1250" pr="c" duble="2" pr_family="2" /> <item3 pr_width="1250" pr="c" duble="2" pr_family="2" /> <item3 pr_width="1250" pr="c" duble="2" pr_family="2" /> <item2 pr="a" duble="3" pr_width="1250" pr_family="2" /> [download] but the OUTPUT must be: `<item3 pr="a" duble="1" pr_width="1250" pr_family="2" /> <item3 pr="b" duble="1" pr_width="1250" pr_family="2" /> <item3 pr="c" duble="1" pr_width="1250" pr_family="2" /> <item3 pr="a" duble="2" pr_width="1250" pr_family="2" /> <item3 pr="b" duble="2" pr_width="1250" pr_family="2" /> <item3 pr="c" duble="2" pr_width="1250" pr_family="2" /> <item2 pr="a" duble="3" pr_width="1250" pr_family="2" />` [download] where I have to put the code? thankyou very much for your precious help	[reply] [d/l] [select]
Re^3: delete duplicated xml lines by hbm (Hermit) on Aug 09, 2012 at 17:51 UTC
Please provide all of your code.	[reply]
Re^4: delete duplicated xml lines by cibiena (Initiate) on Aug 09, 2012 at 22:30 UTC
Re^5: delete duplicated xml lines by hbm (Hermit) on Aug 10, 2012 at 13:31 UTC
Some notes below your chosen depth have not been shown here
Re: delete duplicated xml lines by Kenosis (Priest) on Aug 09, 2012 at 02:59 UTC
Although hbm makes a good point, in case you do want to delete duplicate xml lines, here's one way: use Modern::Perl; my %seen; say for grep { chomp; !$seen{$_}++ } <DATA>; __DATA__ <item pr_1="a" pr_2="2" internal="co_1" pr_family="2" /> <item pr_1="b" pr_2="2" internal="co_1" pr_family="2" /> <item pr_1="c" pr_2="2" internal="co_1" pr_family="2" /> <item pr_1="a" pr_2="1" internal="co_1" pr_family="2" /> <item pr_1="b" pr_2="1" internal="co_1" pr_family="2" /> <item pr_1="c" pr_2="1" internal="co_1" pr_family="2" /> <item pr_1="a" pr_2="2" internal="co_1" pr_family="2" /> <item pr_1="b" pr_2="2" internal="co_1" pr_family="2" /> <item pr_1="c" pr_2="2" internal="co_1" pr_family="2" /> [download] Output: `<item pr_1="a" pr_2="2" internal="co_1" pr_family="2" /> <item pr_1="b" pr_2="2" internal="co_1" pr_family="2" /> <item pr_1="c" pr_2="2" internal="co_1" pr_family="2" /> <item pr_1="a" pr_2="1" internal="co_1" pr_family="2" /> <item pr_1="b" pr_2="1" internal="co_1" pr_family="2" /> <item pr_1="c" pr_2="1" internal="co_1" pr_family="2" />` [download] Hope this helps!	[reply] [d/l] [select]