Confidence Builders: Evaluating Seasonal Climate Forecasts from User Perspectives
Bull. Amer. Meteor. Soc., 83 (5):
683--698 (May 1, 2002)DOI: 10.1175/1520-0477(2002)083%3C0683:cbescf%3E2.3.co;2
Abstract
Abstract Water managers, cattle ranchers, and wildland fire managers face several barriers to effectively using climate forecasts. Repeatedly, these decision makers state that they lack any quantitative basis for evaluating forecast credibility. That is because the evaluations currently available typically reflect forecaster perspectives rather thanthose of users, or are not available in forms that users can easily obtain or understand. Seasonal climateforecasts are evaluated from the perspective of distinct user groups, considering lead times, seasons, and criteria relevant to their specific situations. Examples show how results targeted for different user perspectives can providedifferent assessments of forecast performance. The forecasts evaluated are the official seasonal temperature andprecipitation outlooks issued by the NOAA Climate Prediction Center, produced in their present format since December 1994. It is considered how forecast formats can affect the ease, accuracy, and reliability of interpretation, andsuggest that the ?climatology? designation be modified to better reflect complete forecast uncertainty. A graphical product is presented that tracks time evolution of the forecasts and subsequent observations. The framework for evaluation has multiple quantitative forecast performance criteria that allow individuals to choose the level of sophistication of analysis that they prefer.