Re: How to scrape an HTTPS website that has JavaScript

Sometimes you can't do what you want, but sometimes you can grab the Javascript code and run it though Javascript. I have successfully done this, but it was a specialized case. Don't forget to install the necessary Javascript libriaries as prescribed in the docs for that module, by the way.

jeffa

L-LL-L--L-LL-L--L-LL-L--
-R--R-RR-R--R-RR-R--R-RR
B--B--B--B--B--B--B--B--
H---H---H---H---H---H---
(the triplet paradiddle with high-hat)

Comment on Re: How to scrape an HTTPS website that has JavaScript

Replies are listed 'Best First'.
Re^2: How to scrape an HTTPS website that has JavaScript by McMahon (Chaplain) on Aug 23, 2004 at 16:15 UTC
jeffa, if you had any trivial sample code to do this, it would be great to see it. I've failed to do this before...	[reply]
Re^3: How to scrape an HTTPS website that has JavaScript by jeffa (Bishop) on Aug 23, 2004 at 16:23 UTC
Here ya go: it's old and the demo link is down because i am ... still being lazy. :D Still, it was fun while it lasted. (jeffa) Re: Encrypt web files! jeffa L-LL-L--L-LL-L--L-LL-L-- -R--R-RR-R--R-RR-R--R-RR B--B--B--B--B--B--B--B-- H---H---H---H---H---H--- (the triplet paradiddle with high-hat)	[reply]