how to get full webpage containts from a webpage

huzefa52 has asked for the wisdom of the Perl Monks concerning the following question:

suppose there is a webpage in which list menu button is present so when i click on that list button drop down comes from where I can select particular thing. Now, my question is I want the content that is present in that list button because if i normally fetch the page contents it doesnt give me the content of list options. Can anyone please help me on this. I want code in perl only.

Comment on how to get full webpage containts from a webpage

Replies are listed 'Best First'.
Re: how to get full webpage containts from a webpage by Corion (Patriarch) on Aug 22, 2013 at 12:42 UTC
Have you looked at WWW::Mechanize? In what way did it fail to work for you? Have you looked at the additional requirements that you need? Does the target page work without Javascript? Consider looking at WWW::Scripter, WWW::Mechanize::Plugin::JavaScript and/or WWW::Mechanize::Firefox. Note that most likely, you will need to also use Javascript in addition to the modules mentioned above.	[reply]
Re^2: how to get full webpage containts from a webpage by huzefa52 (Novice) on Aug 22, 2013 at 12:45 UTC
Thanks for the reply. Basically its a SOLR 4.3 UI page where the list of cores are in list option. so, I am not able to access that cores names.	[reply]
Re^3: how to get full webpage containts from a webpage by tobyink (Canon) on Aug 22, 2013 at 15:30 UTC
You know, Solr allows you to request JSON or XML instead of HTML... might be a bit easier. http://wiki.apache.org/solr/SchemaRESTAPI `use Moops; class Cow :rw { has name => (default => 'Ermintrude') }; say Cow->new->name"`	[reply]
Re: how to get full webpage containts from a webpage by daxim (Curate) on Aug 22, 2013 at 12:43 UTC
I am guessing you need to execute JavaScript to get the content you desire. This is a FAQ. Since you want a Perl-only solution, I recommend WWW::Scripter.	[reply]
Re^2: how to get full webpage containts from a webpage by huzefa52 (Novice) on Aug 22, 2013 at 12:47 UTC
Ok, let me try with WWW::Mechanize	[reply]
Re: how to get full webpage containts from a webpage by mishin (Sexton) on Aug 22, 2013 at 12:46 UTC
give me example of page? i'll be do something like this https://gist.github.com/mishin/5925468	[reply]