Beefy Boxes and Bandwidth Generously Provided by pair Networks Cowboy Neal with Hat
laziness, impatience, and hubris
 
PerlMonks  

Re: Reading particular information from Html page and skipping the page that doesn't contain that information

by Anonymous Monk
on May 23, 2012 at 13:28 UTC ( #972037=note: print w/ replies, xml ) Need Help??


in reply to Reading particular information from Html page and skipping the page that doesn't contain that information

User their API http://www.ebi.ac.uk/Tools/webservices/, http://www.ebi.ac.uk/Tools/webservices/help/faq. Don't automate the web page and respect the 'fair share' policy they operate.


Comment on Re: Reading particular information from Html page and skipping the page that doesn't contain that information
Re^2: Reading particular information from Html page and skipping the page that doesn't contain that information
by Kenosis (Deacon) on May 23, 2012 at 13:36 UTC

    Excellent, Anonymous Monk. I applaud your encouraging respect for an institution's sharing policy.

      As an aside, “following such admonitions when they are made by an important data-provider” is not entirely altruistic:   in practice, it is a very important survival strategy.   When you design and build a business system that is intended to obtain information from a third-party data source, you obviously (should...) be designing that system to be durable.   You want to “do it right the first time such that you never have to re-visit it again,” not merely “to design an oh-so lokkit-me I’m-so-gosh-darned clever” ... hack.   You do not want to show up to work one day to find that the data provider made some slight change to their web-page last night and now thirteen hours (and counting) of vital production activity is scroo’d up with y-o-u-r asterisk-is-grass name on it.   Therefore, if a provider tells you the right way to do something, do it.

      (Trust me on this one ....)

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://972037]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others examining the Monastery: (9)
As of 2013-05-18 23:38 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The best material for plates (tableware) is:









    Results (396 votes), past polls