advait has asked for the wisdom of the Perl Monks concerning the following question:
<noscript> <div class="ae_error_area">ArrayExpress uses JavaScript fo +r better data handling and enhanced representation. Please enable Jav +aScript if you want to continue browsing ArrayExpress.</div> </noscript>
Can you please suggest how can I over come this problemuse LWP::Simple; use HTTP::Cookies; use LWP::UserAgent; use HTTP::Request::Common qw(GET); my $ua = LWP::UserAgent->new; my $url= 'http://www.ebi.ac.uk/arrayexpress/q-aer/leukemia%20Homo%2 +0sapiens'; # Define user agent type $ua->agent('Mozilla/8.0'); # Cookies $ua->cookie_jar( HTTP::Cookies->new( file => 'mycookies.txt', autosave => 1 ) ); my $content = get $url; die "Couldn't get $url" unless defined $content; print $content
|
|---|
| Replies are listed 'Best First'. | |
|---|---|
|
Re: How to enable java script in automated webpage retrieval
by moritz (Cardinal) on Jul 03, 2008 at 17:40 UTC | |
|
Re: How to enable java script in automated webpage retrieval
by pjotrik (Friar) on Jul 03, 2008 at 18:30 UTC |