Evaluating probabilistic forecasts of extremes using continuous ranked probability score distributions - ANR - Agence nationale de la recherche Accéder directement au contenu
Article Dans Une Revue International Journal of Forecasting Année : 2023

Evaluating probabilistic forecasts of extremes using continuous ranked probability score distributions

Résumé

Verification of probabilistic forecasts for extreme events has been a very active field of research, stirred by media and public opinions who naturally focus their attention on extreme events, and easily draw biased conclusions. In this context, classical verification methodologies tailored for extreme events, such as thresholded and weighted scoring rules, have undesirable properties that cannot be mitigated; the well-known Continuous Ranked Probability Score (CRPS) makes no exception. In this paper, we define a formal framework to assess the behavior of forecast evaluation procedures with respect to extreme events, that we use to point out that assessment based on the expectation of a proper score is not suitable for extremes. As an alternative, we propose to study the properties of the CRPS as a random variable using extreme value theory to address extreme events verification. To compare calibrated forecasts, an index is introduced that summarizes the ability of probabilistic forecasts to predict extremes. Its strengths and limitations are discussed using both theoretical arguments and simulations.
Fichier principal
Vignette du fichier
tail1.pdf (1.1 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03775400 , version 1 (13-09-2022)

Licence

Paternité

Identifiants

Citer

Maxime Taillardat, Anne-Laure Fougères, Philippe Naveau, Raphaël de Fondeville. Evaluating probabilistic forecasts of extremes using continuous ranked probability score distributions. International Journal of Forecasting, 2023, 39 (3), pp.1448-1459. ⟨10.1016/j.ijforecast.2022.07.003⟩. ⟨hal-03775400⟩
445 Consultations
749 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More