Verification Statistics (verification + statistics)

Distribution by Scientific Domains


Selected Abstracts


Use of medium-range ensembles at the Met Office 2: Applications for medium-range forecasting

METEOROLOGICAL APPLICATIONS, Issue 3 2002
M V Young
The term ,medium range' is taken to refer to forecasts for lead times ranging from about 2 or 3 days ahead up to about 10 days ahead. A wide variety of numerical model products are available to the forecaster nowadays, and one of the most important of these is the ECMWF Ensemble Prediction System (EPS). This paper shows how forecasters at the Met Office use these products, in particular the EPS, in an operational environment in the production of medium-range forecasts for a variety of customers, and illustrates some of the techniques involved. Particular reference is made to the PREVIN post-processing system for the EPS which is described in the companion paper by Legg et al. (2002). Forecast products illustrated take the form of synoptic charts (produced primarily via Field Modification software), text guidance and other graphical formats. The probabilistic approach to forecasting is discussed with reference to various examples, in particular the application of the EPS in providing early warnings of severe weather for which risk assessment is increasingly important. A central theme of this paper is the vital role played by forecasters in interpreting the output from the models in terms of the likely weather elements, and using the EPS to help assess confidence levels for a particular forecast as well as possible alternative synoptic evolutions. Verification statistics are presented which demonstrate how the EPS helps the forecaster to add value to the wide range of individual deterministic model products and that furthermore, the forecaster can improve upon many probabilistic products derived directly from the ensemble. Copyright © 2002 Royal Meteorological Society. [source]


The generation of monthly gridded datasets for a range of climatic variables over the UK

INTERNATIONAL JOURNAL OF CLIMATOLOGY, Issue 8 2005
Matthew Perry
Abstract Monthly or annual 5 km × 5 km gridded datasets covering the UK are generated for the 1961,2000 period, for 36 climatic parameters. As well as the usual elements of temperature, rainfall, sunshine, cloud, wind speed, and pressure, derived temperature variables (such as growing-season length, heating degree days, and heat and cold wave durations) and further precipitation variables (such as rainfall intensity, maximum consecutive dry days, and days of snow, hail and thunder) are analysed. The analysis process uses geographical information system capabilities to combine multiple regression with inverse-distance-weighted interpolation. Geographic and topographic factors, such as easting and northing, terrain height and shape, and urban and coastal effects, are incorporated either through normalization with regard to the 1961,90 average climate, or as independent variables in the regression. Local variations are then incorporated through the spatial interpolation of regression residuals. For each of the climatic parameters, the choice of model is based on verification statistics produced by excluding a random set of stations from the analysis for a selection of months, and comparing the observed values with the estimated values at each point. This gives some insight into the significance, direction, and seasonality of factors affecting different climate elements. It also gives a measure of the accuracy of the method at predicting values between station locations. The datasets are being used for the verification of climate modelling scenarios and are available via the Internet. © Crown Copyright 2005. Reproduced with the permission of Her Majesty's Stationery Office. Published by John Wiley & Sons, Ltd. [source]


Preliminary reconstructions of spring precipitation in southwestern Turkey from tree-ring width

INTERNATIONAL JOURNAL OF CLIMATOLOGY, Issue 2 2003
Ramzi Touchan
Abstract Two reconstructions of spring (May,June) precipitation have been developed for southwestern Turkey. The first reconstruction (1776,1998) was developed from principal components of nine chronologies of Cedrus libani, Juniperus excelsa, Pinus brutia, and Pinus nigra. The second reconstruction (1339,1998) was derived from principal components of three J. excelsa chronologies. Calibration and verification statistics of both reconstructions indicate reasonably accurate reconstruction of spring precipitation for southwestern Turkey, and show clear evidence of multi-year to decadal variations in spring precipitation. The longest period of reconstructed spring drought, defined as consecutive years with less than 80% of normal May,June precipitation, was 4 years (1476,79). Only one drought event of this duration has occurred during the last six centuries. Monte Carlo analysis indicates a less than 33% probability that southwestern Turkey has experienced spring drought longer than 5 years in the past 660 years. Apart from the 1476,79 extended dry period, spring droughts of 3 years in length have only occurred from 1700 to the present. The longest reconstructed wet period, defined as consecutive years with more than 120% of normal May,June precipitation, was 4 years (1532,35). The absence of extended spring drought during the 16th and 17th centuries and the occurrence of extended wet spring periods during these centuries suggest a possible regime shift in climate. Preliminary analysis of links between large-scale climatic variation and these climate reconstructions shows that there is a relationship between extremes in spring precipitation and anomalous atmospheric circulation in the region. Copyright © 2003 Royal Meteorological Society. [source]


Forecast verification: current status and future directions

METEOROLOGICAL APPLICATIONS, Issue 1 2008
Dr B. Casati
Abstract Research and development of new verification strategies and reassessment of traditional forecast verification methods has received a great deal of attention from the scientific community in the last decade. This scientific effort has arisen from the need to respond to changes encompassing several aspects of the verification process, such as the evolution of forecasting systems, or the desire for more meaningful verification approaches that address specific forecast user requirements. Verification techniques that account for the spatial structure and the presence of features in forecast fields, and which are designed specifically for high-resolution forecasts have been developed. The advent of ensemble forecasts has motivated the re-evaluation of some of the traditional scores and the development of new verification methods for probability forecasts. The expected climatological increase of extreme events and their potential socio-economical impacts have revitalized research studies addressing the challenges concerning extreme event verification. Verification issues encountered in the operational forecasting environment have been widely discussed, verification needs for different user communities have been identified, and models to assess the forecast value for specific users have been proposed. Proper verification practice and correct interpretation of verification statistics has been extensively promoted with recent publications and books, tutorials and workshops, and the development of open-source software and verification tools. This paper addresses some of the current issues in forecast verification, reviews some of the most recently developed verification techniques, and provides recommendations for future research. Copyright © 2008 Royal Meteorological Society and Crown in the right of Canada. [source]