rt1 development of the ensemble prediction system aim build and test an ensemble prediction system...
TRANSCRIPT
![Page 1: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/1.jpg)
RT1
Development of the Ensemble Prediction System
Aim
Build and test an ensemble prediction system based on global Earth System models developed in Europe, for use in generation of multi-model simulations of future climate in RT2
Coordinators: James Murphy, Tim Palmer
![Page 2: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/2.jpg)
We can produce a small number of different predictions with no idea of how reliable they might be
Status of Long Term Climate Change Prediction
![Page 3: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/3.jpg)
PROBABILISTIC CLIMATE PREDICTIONS
2080s SE England winter rainfall
Pro
bab
ilit
y
0% 20% 40% 60% 2080s SE England winter rainfall
Pro
bab
ilit
y
100%
0% 20% 40% 60%
current position required position
![Page 4: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/4.jpg)
What distinguishes an ensemble prediction “system” from an ensemble
prediction ?
• Large ensembles
• A systematic, traceable and comprehensive approach to sampling uncertainties
• Methods of converting ensembles of model simulations into probabilistic predictions
• Objective methods of justifying the forecast probabilities
![Page 5: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/5.jpg)
Ensemble climate prediction for different time scales
Seasonal to Decadal Predictions
• Initial value problem, external forcing may be important too.
• Probabilistic hindcasts can be verified
Decadal to Centennial Predictions
• External forcing problem, initial conditions may be important too.
• Probabilistic hindcasts cannot be verified
![Page 6: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/6.jpg)
Version 1 of Ensemble Prediction System
• Recommended design by month18, specified system by month 24.
• Will be used by RT2A to generate a second stream of “production” global climate simulations in years 3 and 4
• Will comprise separate systems for seasonal to decadal and multi-decadal prediction
![Page 7: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/7.jpg)
Version 2 of Ensemble Prediction System
• Specifed system at month 60
• Will seek to extend the range of uncertainties sampled
• Improved methods of constructing probabilistic predictions
• Based on the concept of a single, generalised system for seasonal to centennial prediction ?
![Page 8: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/8.jpg)
Y = uncertainties fully sampled by the end of ENSEMBLES
y = uncertainties partially sampled by the end of ENSEMBLES
y = uncertainties partially sampled at the start of ENSEMBLES
Structural Parameter Stochastic
Atmospheric physics y y y
Ocean physics y y
Terrestrial carbon cycle y y
Ocean carbon cycle y
Sulphur cycle y y
Other atmospheric chemistry y
ENSEMBLES will be a major step forward ..but ensemble climate prediction will not be a solved problem by the end of the project……….
![Page 9: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/9.jpg)
Defining Version 1 of the Seasonal to Decadal System
• Will compare 3 different methods of sampling modelling uncertainties
• Multi-model ensemble (7 models)• Ensemble of versions of one model (HadCM3
with perturbed parameters)• Sampling of stochastic parameterisation
uncertainties in one model (ECMWF)• Will also consider initial condition uncertainties
(9 member ensembles)
![Page 10: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/10.jpg)
RT1 Seasonal to decadal experiments
Use of the multi-model, perturbed parameters and stochastic physics methods to estimate forecast uncertainty in a co-ordinated experiment.
Pre-production (initial 18-months) for the period 1991-2001 with two 6-month (starting in May and November) and one annual ensemble integrations.
Pre-production multi-annual integrations with start dates in 196x and 199x.
Ocean initial conditions from EU-funded project ENACT and generation of new sets when possible.
Common output archived at ECMWF.
![Page 11: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/11.jpg)
DEMETER Multi-model: Reliability
0.0390.8990.141
BSSRel-ScRes-Sc
0.0390.8990.140
0.0950.9260.169
-0.001 0.877 0.123
0.0650.9180.147
-0.064 0.838 0.099
0.0470.8930.153
0.2040.9900.213
Reliability for T2m>0, 1-month lead, May start, 1980-2001
![Page 12: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/12.jpg)
DEMETER Multi-model: Impact of ensemble size
![Page 13: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/13.jpg)
University of Oxford contribution to ENSEMBLES through climateprediction.net :
a global facility for ultra-large AOGCM ensembles
• Beta-test of coupled HadCM3/HadCM3L ensemble by end 2004.• Initial coupled experiment: large initial-condition ensemble, using ENSEMBLES community PCs?
![Page 14: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/14.jpg)
Decadal Prediction Methodology• Need to initialise from observed conditions• *And* need to include external forcings (GHGs,
aerosols, volcanoes, solar,..)
HadCM3 hindcasts of global mean surface air temperature
![Page 15: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/15.jpg)
• A perturbed parameter ensemble of HadCM3 will be generated and compared against the first multi-model ensemble of RT2A
• The HadCM3 ensemble will consist of:• 1860-2100 simulations with 16 HadCM3 versions with
multiple perturbations to uncertain surface and atmospheric parameters
• Augmented by additional pseudo-transient simulations obtained by scaling the equilibrium responses of 128 2xCO2 simulations of the “slab” version of HadCM3
Defining Version 1 of the Centennial System
![Page 16: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/16.jpg)
Climate sensitivity in a large perturbed parameter ensemble
Red histogram shows results from a new ensemble of 128 HadSM3 (slab) model versions designed to produce good present day climate simulations while maximising coverage of parameter space and climate sensitivity
Multiple parameter perturbations (128 runs)
Single parameter perturbations (53 runs)
![Page 17: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/17.jpg)
Example Output: NW Europe temperatures under A2 scenario
Inferred by scaling from equilibrium responses of HadSM3 ensemble members
![Page 18: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/18.jpg)
Coupled Model Ensembles
1% per year CO2 increase
HadCM3 perturbed physics CMIP2 multi-model
![Page 19: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/19.jpg)
Evaluating Centennial Ensemble Prediction Systems• Predictions cannot be verified• So how do we know when we’ve got the best possible system
?
Sampling the widest possible range of modelling uncertainties
Sampling the space consistent with observational constraints Reliable probabilities on the seasonal-decadal time scale as a
necessary condition for trusting the system in centennial prediction
![Page 20: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/20.jpg)
RT1 Workpackages• 1.0: Management
• 1.1 Construction of Earth System Models
• 1.2 Methods of representing uncertainty
• 1.3 Initialising the ocean
• 1.4 Assembling the multi-model system
• 1.5 “pre-production” seasonal to decadal predictions
• 1.6 “pre-production” centennial predictions
![Page 21: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/21.jpg)
1.1 Construction of Earth System Models
• Put together a number of ESMs from existing modules • Demonstrate performance in test simulations• (CNRM, Free Univ Berlin, Hadley Centre, MPI, DMI, IPSL)• Available for reassembly in different combinations using PRISM• Available for use in systematic perturbation experiments
Major Milestone
A set of tested ESMs available for use in the ensemble prediction system by month 24.
![Page 22: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/22.jpg)
1.2 Methods of representing uncertainty
• How to perturb model processes
• How to weight models according to reliability
• How to combine different approaches
Design ensemble Apply metric of reliability
Generate probabilistic prediction
![Page 23: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/23.jpg)
1.3: Ocean initialisation procedures based on observed states
Objective:
To develop techniques to initialise ESMs and to represent uncertainties in the ICs for the ESM integrations
Content:
Initialization techniques will be based on advanced data assimilation systems (variational, EnKF, OI) developed under ENACT.
Extension of ENACT data-set of quality-controlled in situ observations.
Development of an ensemble generation strategy to account for IC uncertainties.
Possibilities include:
– Using individual systems to generate ensembles of ocean analyses by perturbing surface forcing fields, observations and/or model equations.
– Using the analyses generated by the different assimilation systems to define the ensemble.
![Page 24: RT1 Development of the Ensemble Prediction System Aim Build and test an ensemble prediction system based on global Earth System models developed in Europe,](https://reader037.vdocuments.us/reader037/viewer/2022102900/5513e3b55503463a298b59d0/html5/thumbnails/24.jpg)
Some Issues for Discussion in RT1
• Coordination with other RTs (especially RT2)• Facilitate comparison of multimodel and perturbed physics
ensembles Data from model integrations Emissions/forcing scenarios• Scoring metrics for seasonal to decadal ensembles• Quality metrics for centennial ensembles• Strategy for perturbation of ocean initial conditions• Methodology and choice of dates for decadal predictions• A large initial condition ensemble from climateprediction.net ?• Website• … and more …