Re: Retrieving contents of web pages

Something like this?

use LWP::Simple;
my $page = get('http://username:password@www.example.com/page.html');
[download]

(not tested this way of doing username and password, but should work). andy.

Comment on Re: Retrieving contents of web pages Download Code

Replies are listed 'Best First'.
Re: Re: Retrieving contents of web pages by domm (Chaplain) on Aug 29, 2001 at 23:36 UTC
Quoting from RFC 2396: 3.2.2. Server-based Naming Authority URL schemes that involve the direct use of an IP-based protocol to a specified server on the Internet use a common syntax for the server component of the URI's scheme-specific data: <userinfo>@<host>:<port> where <userinfo> may consist of a user name and, optionally, scheme specific information about how to gain authorization to access the server. The parts "<userinfo>@" and ":<port>" may be omitted. server = [ [ userinfo "@" ] hostport ] The user information, if present, is followed by a commercial at-sign "@". userinfo = *( unreserved \| escaped \| ";" \| ":" \| "&" \| "=" \| "+" \| "$" \| "," ) Some URL schemes use the format "user:password" in the userinfo field. This practice is NOT RECOMMENDED, because the passing of authentication information in clear text (such as URI) has proven to be a security risk in almost every case where it has been used. [download] BTW, I am using my $page = get('http://username:password@www.example.com/page.html'); and it is working. (I am not using this over the internet, see the security advice ..)	[reply] [d/l]

Replies are listed 'Best First'.

Re: Re: Retrieving contents of web pages
by domm (Chaplain) on Aug 29, 2001 at 23:36 UTC

RFC 2396

3.2.2. Server-based Naming Authority

URL schemes that involve the direct use of an IP-based protocol to
a specified server on the Internet use a common syntax for the
server component of the URI's scheme-specific data:

      <userinfo>@<host>:<port>

 where <userinfo> may consist of a user name and, optionally, scheme
 specific information about how to gain authorization to access the
 server.  The parts "<userinfo>@" and ":<port>" may be omitted.

      server        = [ [ userinfo "@" ] hostport ]

 The user information, if present, is followed by a commercial
 at-sign "@".

    userinfo      = *( unreserved | escaped |
                 ";" | ":" | "&" | "=" | "+" | "$" | "," )

 Some URL schemes use the format "user:password" in the userinfo
 field. This practice is NOT RECOMMENDED, because the passing of
 authentication information in clear text (such as URI) has proven
 to be a security risk in almost every case where it has been 
 used.
[download]

[reply]
[d/l]