Hello fellow monks!
I've been trying to retrieve some data from a certain type of webpages, like the followings:
http://www.ncbi.nlm.nih.gov/nuccore/298379586?from=489972&to=491012 http://www.ncbi.nlm.nih.gov/nuccore/307551844?from=1037615&to=1038667 http://www.ncbi.nlm.nih.gov/nuccore/309700213?from=1125254&to=1126294
As you can see there are all of the same kind. What I need to extract is the sequence, namely the last part, from ORIGIN onwards, which has numbers 1, 61, 121, etc in the begining. If I could download the page, I believe that I could create a pattern match script to get the sequence, but with

 wget "http://www.ncbi.nlm.nih.gov/nuccore/309700213?from=1125254&to=1126294"

for example, I DO NOT get the same page that we see on the web. The only way I can get the same page is by doing File->Save Page as, which apparently can't be done for 1000+ pages...
Is there a way of either retrieving the data I need WITHOUT having to download the page OR a way to download the page BUT ensuring that I get EXACTLY the same data inside?
Thanks in advance!

In reply to Extract data from web page! by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.