Re: Evaluation problems
Posted by Lowell on April 09, 2002 at 23:11:11:

Hi Roger,
Thanks for the warning regarding the problems inherent in your sampling technique.
Those who make predictions will be happy to have this aid. It is certainly a giant
step in the right direction, albeit less than perfect.
I think for contests on this board, the decision of the judges should be allowed
to be queried in case the earthquake is found in a catalog other than CNSS, otherwise
the decision of the judges should be considered final. If the earthquake is found
in another catalog but not in CNSS, no probability can be assigned, and thus the
forecast cannot be completely evaluated. In this case, the winner will remain the
one whose event was in the CNSS catalog with the caveat that only CNSS events
will be assigned probabilities.
Hence a new rule for the contests:

Only events found in the CNSS global catalog will be considered for evaluation
of forecasts/predictions.


Follow Ups:
     ● Iran quake -Self evaluation ! - R.Shanmugasundaram  21:08:33 - 4/10/2002  (14753)  (1)
        ● wrong - Roger Hunter  10:51:38 - 4/11/2002  (14762)  (1)
           ● Right.. - R.Shanmugasundaram  21:06:54 - 4/11/2002  (14775)  (4)
              ● Whoa, there, partner! - Cathryn  11:28:55 - 4/12/2002  (14809)  (1)
                 ● Forget - R.Shanmugasundaram  20:17:50 - 4/12/2002  (14824)  (2)
                    ● Re: Forget - Cathryn  08:13:18 - 4/13/2002  (14844)  (0)
                    ● Re: Forget - Roger Hunter  05:21:33 - 4/13/2002  (14841)  (1)
                       ● Re: Forget - R.Shanmugasundaram  03:06:39 - 4/14/2002  (14883)  (1)
                          ● Re: Forget - Roger Hunter  05:15:28 - 4/14/2002  (14886)  (0)
              ● Re: Right.. - Lowell  09:21:47 - 4/12/2002  (14806)  (0)
              ● Re: Right.. - Roger Hunter  06:09:26 - 4/12/2002  (14801)  (0)
              ● Re: Right.. Not accurate enough - Don In Hollister  22:56:35 - 4/11/2002  (14783)  (1)
                 ● Using scale not satellite - R.Shanmugasundram  07:39:57 - 4/12/2002  (14803)  (1)
                    ● Re: Using scale not satellite - Petra Challus  01:12:44 - 4/13/2002  (14836)  (0)