in reply to Bayesian not-for-spam

You look like you might be trying to predict things like the stock market. If so, then please note that both theory and practice indicate that stock prices follow a random walk. There is no correlation between what they have done in the past and what they will do in the future. (Other than an overall tendancy to climb about 10% per year. OTOH that is a trend which we are currently well above the historical average for...)

Thus a computer program to predict the prices is unlikely to yield anything useful. Though our human tendancy to see patterns whether or not they are there will cause you to find all sorts of spurious things if you tinker enough..spurious connections that won't hold up with future data.

Replies are listed 'Best First'.
Re: Re: Bayesian not-for-spam
by wufnik (Friar) on Jul 15, 2003 at 10:39 UTC
    hmmm, tilly, whether you accept the random walk hypothesis depends on how orthodox your economics are. Lo & MacKinlay, at MIT, in "A Non Random Walk down Wall Street" (1999) obtained overwhelming rejections of random walk; there is quite compelling evidence against it. i append a quote from Niederhoffer's biography you might find interesting.

    This theory and the attitude of its adherents found classic expression in one incident I personally observed that deserves memorialization. A team of four of the most respected graduate students in finance had joined forces with two professors, now considered venerable enough to have won or to have been considered for a Nobel prize, but at that time feisty as Hades and insecure as a kid on his first date. This elite group was studying the possible impact of volume on stock price movements, a subject I had researched. As I was coming down the steps from the library on the third floor of Haskell Hall, the main business building, I could see this Group of Six gathered together on a stairway landing, examining some computer output. Their voices wafted up to me, echoing off the stone walls of the building. One of the students was pointing to some output while querying the professors, "Well, what if we really do find something? We'll be up the creek. It won't be consistent with the random walk model." The younger professor replied, "Don't worry, we'll cross that bridge in the unlikely event we come to it." I could hardly believe my ears--here were six scientists openly hoping to find no departures from ignorance. I couldn't hold my tongue, and blurted out, "I sure am glad you are all keeping an open mind about your research." I could hardly refrain from grinning as I walked past them. I heard muttered imprecations in response.

    respectfully,

    ...wufnik
    -- in the world of the mules there are no rules --
      Oh, I don't doubt that the random walk hypothesis has limits. Warren Buffett is enough proof of that. However it is true enough that it is highly unlikely that a casual amateur should be strongly advised to not try beating random stock movements.

      And it is an accurate enough approximation that, whatever the flaws, it has become established orthodox financial theory.