in reply to Re^3: web search for certain data
in thread web search for certain data

As i have told i have no clue to how to solve my problem i need help in getting started at the solution for the problem i have mentioned.

i have tried writing a code that somehow does not make any sense to me either.I have a medical journal site, which has many published articles. I need to go down to each page and get details like Author, time published and abstract. For all that to start i need to get that html content to a text file, i have used LWP::simple get method to get the content,which somehow does not get the exact data from site. Is ther any other method to read an html into a txt file?

Replies are listed 'Best First'.
Re^5: web search for certain data
by Corion (Patriarch) on Nov 23, 2011 at 20:12 UTC

    So, is your problem that you have code which does not download the complete HTML?

    If your problem is something else, you should maybe state that, and accompagny it with the relevant code. And maybe stop talking about how your existing program that you keep hidden does not work.

      As i was telling i didnt have a worthy piece of code yet, but this is what i wrote so far, and when i run this, Mytempoutput file does not have all different meta content from the site.
      use LWP::Simple; use HTML::Parse; #Parsing the http file for the required fields $url = 'http://content.karger.com/ProdukteDB/produkte.asp?Aktion=ShowA +bstract&ArtikelNr=6735&Ausgabe=224691&ProduktNr=223832'; $url =~ s/&/=/g ; my @url_mod = split('=', $url); #checking for url and increasing article no. if ($url_mod[5] = 224691) { open(Mytempoutput, ">tempoutput.txt"); print Mytempoutput (get $url); $abs_str=""; $aa[5]= $aa[5]+1; print $aa[5]; }

        So, do you like playing 20 Questions?

        As my next question, I choose: "What parts of the page(s) are missing?"