retrieving secure web page

mrguy123 has asked for the wisdom of the Perl Monks concerning the following question:

Hi monks.
I am trying to retrieve a secure web page using the LWP::UserAgent.
The url I'm sending is this:

 <br>
https://secure.books24x7.com:443/portal/portalsearch.asp?type=content&
+search=comprehensive+introduction
[download]

However, I get this message:

<br>
Warning (call_httpd_LWP_new) : Can't connect to secure.books24x7.com:4
+43 ()
[download]

I can connect to this page using a socket, but I want to be able to retrieve the page with the LWP::UserAgent. I have retrieved secure web pages in the past using the LWP::UserAgent, so it should be possible. Any ideas anybody?

Udate:
Thanks for the tips, mannaged to fix the problem. I will show more code next time.

Comment on retrieving secure web page Select or Download Code

Replies are listed 'Best First'.
Re: retrieving secure web page by Asim (Hermit) on May 23, 2006 at 14:44 UTC
When I try to reach this page in a browser (Firefox 1.5x), I get a message which might explain the situation. Firefox tells me that it is "unable to verify the identity of secure.books24x7.com as a trusted site. I know I can reach 24x7, as I have a login there. So my thought is that LWP, using the SSL modules, is running into the same problem. In it's case, my belief is that it's dropping the potentially insecure connection by default. Taking a quick peek at Crypt::SSLeay, one notes a `HTTPS_DEBUG` environmental variable that you can use to possibly get more data. That would be my suggested next stop, unless someone here has a better suggestion. ----Asim, known to some as Woodrow.	[reply] [d/l]
Re: retrieving secure web page by EdwardG (Vicar) on May 23, 2006 at 14:34 UTC
Show some code so we don't have to guess what you're doing! https could require Crypt::SSLeay	[reply]
Re: retrieving secure web page by jzb (Hermit) on May 23, 2006 at 15:16 UTC
A couple of things... First, your specifying HTTPS and port 443: Unnecessary, drop the 443. Second, This site will require you to accept the certs and login as a user. Did you do this? I concur with the brother above... show code - clean it up if necessary for Inet posting. s/your reality/my reality/g	[reply]