Beefy Boxes and Bandwidth Generously Provided by pair Networks
Just another Perl shrine
 
PerlMonks  

Re: LWP & Javascript

by mitd (Curate)
on Jul 25, 2002 at 08:18 UTC ( [id://185146]=note: print w/replies, xml ) Need Help??


in reply to LWP & Javascript

Read! dws's responses he has handed you the answer.
At the site you are interested in there are/is pages/page that are the only access points to the page you are trying to get.

Those pages/page are testing for javascript and setting a cookie or simply using javascript to set the cookie. Either way no JS no cookie... no cookie no page of interest.

the simple thing to do is go to one of these 'access' pages, view the source and see what cookie is being set. then in your LWP script put the discovered cookie into your cookie jar.

This is a fairly common practice but there are methods that are more complicated but can still be worked around. Try this way and let us know.

Oh yea and don't forget to thank dws. Since all I did was shout his answer back at you :)

mitd-Made in the Dark
'Interactive! Paper tape is interactive!
If you don't believe me I can show you my paper cut scars!'

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://185146]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others surveying the Monastery: (5)
As of 2024-04-24 03:42 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found