Parsing URL using regular expression

knsridhar has asked for the wisdom of the Perl Monks concerning the following question:

Hi Monks

I have written a script which parses mbox and updates into the database. When i get a mail with 8859 character set or quoted printable format, i parse it by

     $message_body =~ s/=([ 0-9A-Fa-f ]{2})/chr(hex($1))/ge;
     $message_body =~ s/=\n//g;
     $message_body =~ s/=3D/=/g;
     $message_body =~ s/>/>\n/g;
[download]

Now the problem is while parsing mails whose body contains hyperlinks with key/value pair, like

http://www.foo.com/bar.pl?aid=3D2744&bid=3D&cn=3DOM=
Ddemo2&rid=3D0
[download]

the message body written to db doesnt contain any hyperlinks. Is there any way to solve this problem

Thanks
Sridhar

Comment on Parsing URL using regular expression Select or Download Code

Replies are listed 'Best First'.
Re: Parsing URL using regular expression by Sec (Monk) on Jul 20, 2005 at 15:24 UTC
I suspect your mistake lies somewhere else. The above mentioned snipped works as expected and keeps the URL parameters: `#!perl -l $message_body="http://www.foo.com/bar.pl?aid=3D2744&bid=3D&cn=3DOM= Ddemo2&rid=3D0"; $message_body =~ s/=([0-9A-Fa-f]{2})/chr(hex($1))/ge; $message_body =~ s/=\n//g; $message_body =~ s/=3D/=/g; $message_body =~ s/>/>\n/g; print $message_body;` [download] results in `http://www.foo.com/bar.pl?aid=2744&bid=&cn=OMDdemo2&rid=0` While we're at it. the third substitute (the one with =3D) seems unnecessary, as the first substitute already transforms =3D into =.	[reply] [d/l] [select]
Re: Parsing URL using regular expression by Jaap (Curate) on Jul 20, 2005 at 15:22 UTC
What do you mean with: "the message body written to db doesnt contain any hyperlinks" Do you mean the entire URL is not in the database?	[reply]
Re^2: Parsing URL using regular expression by knsridhar (Scribe) on Jul 20, 2005 at 15:30 UTC
Yes, the entire URL is not written to the database	[reply]
Re: Parsing URL using regular expression by Anonymous Monk on Jul 20, 2005 at 16:00 UTC
What is your question actually? How to add URLs to a database? How to parse URLs? How to extract URLs from a body of text? How to deal with quoted-printable? `Confused Monk`	[reply]
Re^2: Parsing URL using regular expression by knsridhar (Scribe) on Jul 20, 2005 at 16:23 UTC
My requirement to parse a mail which contains hyperlink with key/value pair in its message body Sorry if i was not clean	[reply]