Don's predictions & Roger's evaluations & Chris's comments
Posted by Ara on October 28, 2005 at 04:49:03:

Roger to Chris: "I've gotta learn not to post preliminary results."

Ya mean like the one above, with 33 meaning 3 sigmas above the center?

Ironic that we have predictors who cannot or who are not willing to explain their method, and we have prediction-evaluation not doing any better in the explanation department. Roger, re-read that paragraph (below)-- did ANYONE make sense of it?

As for specifically Don's cop-out -- he says he is using a "proprietary" method that is not his. Great, whose is it, Don? That a secret too? OK, you have a proprietary method not yours that you are using to publicly predict earthquakes. Next question: do you have permission from the proprietary owner to do so? Has he told you to go ahead and use his method as long as you keep it secret?

To use Glen's apt phrase, none of this "cuts it" with me. Either you tell us about the method, or (if you have not been given permission by the owner) you do not use it and post results publicly.
--------------------

> Not sure if I am getting this right. After 10,000 repetitions, "chance" did no better than 40. Don only got 33. So how is it that "chance" lost? Are you assigning "chance" the median score of 30 and saying that Don's score is higher than that? If so, how do you avoid the temptation to say that Don's score is only slightly higher "by chance"?

Paragraph that stumped me:

No, you're not getting it right. I made 10,000 repetitions of 226 random numbers, comparing them to Don's probabilities and counting the number of times the random number was smaller than Don's. Those counts made up a histogram and the largest number was 40 Don's 33 is 3 sigmas from center.



Follow Ups:
     ● Re: Don's predictions & Roger's evaluations & Chris's comments - Don in Hollister  10:36:21 - 10/28/2005  (29861)  (3)
        ● keep predicting - chris in suburbia  04:44:04 - 10/30/2005  (29907)  (0)
        ● I am pro-prediction, not anti-prediction - Ara  22:45:50 - 10/28/2005  (29896)  (0)
        ● Re: Don's predictions & Roger's evaluations & Chris's comments - Cathryn  13:11:31 - 10/28/2005  (29882)  (0)
     ● a stab at the meaning - John Vidale  07:12:21 - 10/28/2005  (29855)  (2)
        ● Re: a stab at the meaning - Roger Hunter  08:38:35 - 10/28/2005  (29859)  (2)
           ● step down? - John Vidale  18:19:33 - 10/28/2005  (29892)  (1)
              ● Re: step down? - Roger Hunter  18:27:53 - 10/28/2005  (29893)  (1)
                 ● not really - John Vidale  21:19:49 - 10/28/2005  (29895)  (1)
                    ● Very good John - Roger Hunter  05:38:32 - 10/29/2005  (29900)  (1)
                       ● have to see how busy it gets - John Vidale  14:21:37 - 10/29/2005  (29904)  (1)
                          ● Re: have to see how busy it gets - Cathryn  13:18:02 - 10/30/2005  (29919)  (1)
                             ● thanks - John Vidale  17:05:06 - 10/30/2005  (29923)  (0)
           ● aren't we saying the same thing? - John Vidale  13:31:09 - 10/28/2005  (29884)  (1)
              ● Re: aren't we saying the same thing? - Roger Hunter  14:05:07 - 10/28/2005  (29886)  (0)
        ● Stabs at meanings - Ara  07:38:43 - 10/28/2005  (29856)  (1)
           ● pretty much - John Vidale  13:35:23 - 10/28/2005  (29885)  (0)