HiTek has asked for the wisdom of the Perl Monks concerning the following question:

Hello, Monks Sometimes LWP::Agent doesn't download whole page. If I open this page in a browser the page is bigger (there are more information). What can I do to solve this issue? P.S. Maybe this issue has place because sites using AJAX? Thanks

Replies are listed 'Best First'.
Re: Page downloading using LWP::Agent
by Corion (Patriarch) on Feb 18, 2009 at 09:30 UTC

    Find out what the cause is. LWP::UserAgent doesn't know JavaScript and there is no easy way to add JavaScript functionality.

    Consider watching what goes over the wire using Wireshark or Win32::IE::Mechanize, which understands JavaScript.

[reply]

Back to Seekers of Perl Wisdom