in reply to post, return, parse, repeat

NCBI has a number of API's into their databases. A fairly simple model I used a few years ago is the Entrez Programming Utilities. "Esearch" and "Efetch" can be used to grab 100 records at a time in any of a number of formats. Restrictions and guidelines are posted on that page.

Replies are listed 'Best First'.
Re^2: post, return, parse, repeat
by ShayShay (Acolyte) on Feb 14, 2008 at 17:23 UTC
    Thank you! I'll try looking there! Still... I'd like to know what I'm doing wrong.
      NCBI uses javascript. To confirm, try switching it off in your browser and you'll see that clicking the next button just redirects to the main page.

      Normal mechanize can't handle this but there have been some discussions of how to get around this issue for IE and FF.