in reply to RFC: Finance::FuturesQuote

Have you verified with each website's usage policy that screen scraping is ok? Have you looked to see if any of these have a published API?
My criteria for good software:
  1. Does it work?
  2. Can someone else come in, make a change, and be reasonably certain no bugs were introduced?

Replies are listed 'Best First'.
Re^2: RFC: Finance::FuturesQuote
by mojotoad (Monsignor) on Jul 08, 2005 at 21:12 UTC
    Have you verified with each website's usage policy that screen scraping is ok?

    I think it's more the user of the module that should be paying attention to site policies rather than the author of the module. 'personal usage' is just that.

    I remember a similar discussion along these lines a while back: Finance::YahooChart legal opinions?

    Matt

[reply]
Re^2: RFC: Finance::FuturesQuote
by gri6507 (Deacon) on Jul 08, 2005 at 19:16 UTC
    I actually did a google search for an API for any of the number of websites that contain futures quotes - no luck.

    As for researching INO.com's screen-scraping usage - well, thanks for the suggestion. After 10 minutes of browsing the site for policy related entries, I found no entries indicating that such practices are illegal.

[reply]

      Just to be on the safe side, it might be worthwhile checking the robots.txt file, to see if they decide to give you a message to stop doing it.

      See WWW::RobotRules

[reply]

In Section Meditations