in reply to RFC: Finance::FuturesQuote

Have you verified with each website's usage policy that screen scraping is ok? Have you looked to see if any of these have a published API?

My criteria for good software:
  1. Does it work?
  2. Can someone else come in, make a change, and be reasonably certain no bugs were introduced?

Replies are listed 'Best First'.
Re^2: RFC: Finance::FuturesQuote
by mojotoad (Monsignor) on Jul 08, 2005 at 21:12 UTC
    Have you verified with each website's usage policy that screen scraping is ok?

    I think it's more the user of the module that should be paying attention to site policies rather than the author of the module. 'personal usage' is just that.

    I remember a similar discussion along these lines a while back: Finance::YahooChart legal opinions?

    Matt

Re^2: RFC: Finance::FuturesQuote
by gri6507 (Deacon) on Jul 08, 2005 at 19:16 UTC
    I actually did a google search for an API for any of the number of websites that contain futures quotes - no luck.

    As for researching INO.com's screen-scraping usage - well, thanks for the suggestion. After 10 minutes of browsing the site for policy related entries, I found no entries indicating that such practices are illegal.

      Just to be on the safe side, it might be worthwhile checking the robots.txt file, to see if they decide to give you a message to stop doing it.

      See WWW::RobotRules