Re: Evaluation question
Posted by Lowell on March 11, 2002 at 10:55:03:

Here's my 1 cents worth (so 2 cents can also get his in) Roger

It seems to me that there are two questions involved:

1) the geological significance of the prediction

2) the cultural significance of the prediction

These two overlap a bit, but are in some ways different.

For example, take Don's Davao City, Philippines forecast for example. The forecast
was for an event near Davao City, while the earthquake occurred 200 km away
but was felt and did cultural damage at Davao City. The earthquake of M 5 that
was forecast, had it occurred at Davao City as expected, would have had pretty
much the same effect there as did the Mw 7.3 200 km away.
Likewise the forecast for a microearthquake in an unusual place could be quite
important geologically and in terms of developing any earthquake forecasting
technique because if it occurred as expected it could be as important in determining
the correctness of the procedure as a large earthquake 100 km away, perhaps
more so.

The real question is this:

What are the claims of the forecaster in regards to the procedure he/she uses?

If the forecaster claims or wishes to develop a technique that will warn people
of a disastrous earthquake in a populated area on a short-term basis, that is
a very different forecast/prediction than a forecaster who is trying to develop a
technique which will determine where strains are capable of producing earthquakes
(and thus is very interested in microquakes in calibrating and adjusting the
parameters of the forecasting techniques) with an ultimate goal of determining
when large or destructive quakes may occur.

It seems to me that the most important criteria in any evalutation technique is
not time or magnitude or location alone, but rather the probability that an event
would occur by random chance given the stated parameters of the forecast compared
with the claimed correct hit/miss. If it is highly improbable that a forecast and
event would coincide, then it should be considered a hit, no matter how small.

Otherwise we get into the problem of imposing our own judgments of what is
important on the evaluation. That is as bad as being told what is important to
judge by the forecaster. In both cases, the final evaluation is subject to controversy.


Follow Ups:
     ● Re: Evaluation question - Roger Hunter  11:44:43 - 3/11/2002  (13573)  (1)
        ● Re: Evaluation question - chris in suburbia  15:36:51 - 3/11/2002  (13578)  (1)
           ● Re: Evaluation question - Roger Hunter  16:57:13 - 3/11/2002  (13579)  (1)
              ● Re: Evaluation question - Don In Hollister  17:53:25 - 3/11/2002  (13582)  (2)
                 ● Re: Evaluation question - Roger Hunter  19:24:34 - 3/11/2002  (13587)  (0)
                 ● Re: Evaluation question - Canie  19:11:35 - 3/11/2002  (13584)  (1)
                    ● Re: Evaluation question - Roger Hunter  19:33:33 - 3/11/2002  (13588)  (3)
                       ● Re: Evaluation question - michael  16:46:46 - 3/12/2002  (13618)  (1)
                          ● Re: Evaluation question - Roger Hunter  19:13:37 - 3/12/2002  (13626)  (1)
                             ● Re: Evaluation question - michael  16:43:12 - 3/13/2002  (13675)  (1)
                                ● Re: Evaluation question - Roger Hunter  17:32:26 - 3/13/2002  (13678)  (1)
                                   ● Re: Evaluation question - michael  10:55:41 - 3/14/2002  (13718)  (1)
                                      ● Re: Evaluation question - Roger Hunter  14:40:12 - 3/14/2002  (13727)  (0)
                       ● Re: Evaluation question - chris in suburbia  20:03:41 - 3/11/2002  (13590)  (1)
                          ● Re: Evaluation question - Canie  23:39:58 - 3/11/2002  (13592)  (0)
                       ● Re: Evaluation question - Don In Hollister  19:56:42 - 3/11/2002  (13589)  (1)
                          ● Re: Evaluation question - Roger Hunter  05:41:52 - 3/12/2002  (13596)  (2)
                             ● Re: Evaluation question - michael  16:49:00 - 3/12/2002  (13619)  (1)
                                ● Re: Evaluation question - Roger Hunter  19:15:31 - 3/12/2002  (13628)  (1)
                                   ● Re: Evaluation question - michael  16:52:09 - 3/13/2002  (13676)  (1)
                                      ● Re: Evaluation question - Roger Hunter  17:36:10 - 3/13/2002  (13679)  (1)
                                         ● Re: Evaluation question - michael  10:59:13 - 3/14/2002  (13719)  (1)
                                            ● Re: Evaluation question - Roger Hunter  14:45:30 - 3/14/2002  (13728)  (1)
                                               ● Re: Evaluation question - michael  20:25:45 - 3/14/2002  (13738)  (0)
                             ● Re: Evaluation question - Don In Hollister  10:58:53 - 3/12/2002  (13604)  (0)