development of the ensemble navy aerosol analysis...

26
Development of the Ensemble Navy Aerosol Analysis Prediction System and its application of the Data Assimilation Research Testbed in Support of Aerosol Forecasting Juli I. Rubin NRC Postdoctoral Research Associate Naval Research Laboratory, Monterey, CA

Upload: others

Post on 28-Feb-2021

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Development of the Ensemble Navy Aerosol Analysis Prediction System and its

application of the Data Assimilation Research Testbed in Support of Aerosol

Forecasting

Juli I. RubinNRC Postdoctoral Research Associate

Naval Research Laboratory, Monterey, CA

Page 2: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Collaborators:

• Jeff Reid1, Jim Hansen1, Jeff Anderson2, Tim Hoar2, Nancy Collins2, Carolyn Reynolds1, Tim Hogan1, Justin McLay1, Peng Lynch3

1Marine Meteorology Division, Naval Research Laboratory, Monterey, CA2Data Assimilation Research Section, National Center for Atmospheric Research, Boulder, CO3CSC Inc, Monterey, CA

Page 3: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Ensemble NAAPS (ENAAPS)

• Built on 20 member NAVGEM meteorology

• Current ENAAPS forecast initialized with NAVDAS-AOD

1. Ensemble Mean Forecast2. Forecast Uncertainty (ie.

Ensemble Spread)3. Probability Information

1. 2.

3.

Page 4: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

ENAAPS and Ensemble Kalman Filter

• Take full advantage of ensembles

• Replace variational NAVDAS-AOD with an EnKFsystem (DART)

-0.05 0.70

Saharan Dust Plume

Ensemble Correlation Fields MODIS AOT Retrieval

+

Flow-Dependent Corrections to the model state fields

Page 5: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Observation Density of Aerosol-Related Satellite Products

Page 6: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

• July through August, 2013 (SEAC4RS)

• Ensemble type (source, meteorology, combined)

• Constant vs Adaptive Inflation [Anderson, 2007]

• Ensemble size

• 1000 km localization

Experiment Name Ensembles Inflation

Source, const Source, 20 member 10% Constant Covariance Inflation

Source, adaptive Source, 20 member Adaptive Inflation

Meteorology, adaptive Meteorology Only, 20 member Adaptive Inflation

Met+Source, adaptive Meteorology + Source, 20 member Adaptive Inflation

Met+Source, 80 Meteorology + Source, 80 member Adaptive Inflation

= emissions for aerosol species i in grid cell (x,y)= random gaussian perturbation factor for species i, ensemble n (25% uncertainty) = perturbed source for species i, ensemble n

Ensemble Experiment Summary

Covariance Inflation==ensemble member n= ensemble mean=inflation factor

ENAAPS-DART optimization

Page 7: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

ENAAPS-DART optimization• July through August, 2013 (SEAC4RS)

• Ensemble type (source, meteorology, combined)

• Constant vs Adaptive Inflation [Anderson, 2007]

• Ensemble size

• 1000 km localization

Experiment Name Ensembles Inflation

Source, const Source, 20 member 10% Constant Covariance Inflation

Source, adaptive Source, 20 member Adaptive Inflation

Meteorology, adaptive Meteorology Only, 20 member Adaptive Inflation

Met+Source, adaptive Meteorology + Source, 20 member Adaptive Inflation

Met+Source, 80 Meteorology + Source, 80 member Adaptive Inflation

Ensemble Experiment Summary

Covariance Inflation==ensemble member n= ensemble mean=inflation factor

= emissions for aerosol species i in grid cell (x,y)= random gaussian perturbation factor for species i, ensemble n (25% uncertainty) = perturbed source for species i, ensemble n

Page 8: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Ensemble Spread 20130831 18Z, end of optimization experiments

a. Source, constant inflation

Ensemble AOT Standard Deviation/Mean (%)

Assimilated MODIS Obs Count

Impact of Configuration on Ensemble Spread

Page 9: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Ensemble Spread 20130831 18Z, end of optimization experiments

Impact of Configuration on Ensemble Spread

a. Source, constant inflation

Ensemble AOT Standard Deviation/Mean (%)

Assimilated MODIS Obs Count

Page 10: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Ensemble Spread 20130831 18Z, end of optimization experiments

Impact of Configuration on Ensemble Spread

a. Source, constant inflation

Ensemble AOT Standard Deviation/Mean (%)

Assimilated MODIS Obs Count

Page 11: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

a. Source, constant inflation b. Source, adaptive inflation

c. Meteorology, adaptive inflation d. Met+Source, adaptive inflation

Ensemble AOT Standard Deviation/Mean (%)

Ensemble Spread 20130831 18Z, end of optimization experiments

Impact of Configuration on Ensemble Spread

Page 12: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

a. Source, constant inflation b. Source, adaptive inflation

c. Meteorology, adaptive inflation d. Met+Source, adaptive inflation

Ensemble AOT Standard Deviation/Mean (%)

Ensemble Spread 20130831 18Z, end of optimization experiments

Impact of Configuration on Ensemble Spread

RMSE = 0.127Total Spread/RMSE = 0.802

RMSE = 0.123Total Spread/RMSE = 0.82

RMSE = 0.115Total Spread/RMSE = 0.925

RMSE = 0.122Total Spread/RMSE = 0.875

Page 13: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Importance of Met Ensemble for Long-Range Transport

A) Source, adaptive inflation

B) Met+Source, adaptive inflation

Met+Source, adaptive

A)

B)

* Long-range transport of dust completely missed with source-only ensemble

Page 14: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Impact of Source Ensemble

Ensemble Correlation

A) Source B) Meteorology C) Met + Source

So

uth

Afr

ica

n S

mo

ke

A) Source RMSE = 0.133

B) Meteorology RMSE = 0.14

C) Met+Source RMSE = 0.124

6 Hour Forecast relative to MODIS AOT:

Page 15: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Verification Against AERONET

AERONET Sites by Region (2013)

Page 16: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

AERONET Sites by Region (2013)

AERONET

Region R2

Bias RMSE Mean AOT R2

Bias RMSE Mean AOT Mean AOT

N. Africa 0.59 -0.048 0.191 0.348 0.63 0.003 0.188 0.399 0.396

Australia 0.11 -0.016 0.069 0.048 0.08 -0.001 0.064 0.063 0.063

Central America 0.71 -0.026 0.086 0.2 0.76 -0.03 0.085 0.196 0.226

East Asia 0.58 -0.04 0.188 0.326 0.53 -0.035 0.2 0.331 0.366

E.CONUS 0.49 -0.007 0.072 0.154 0.44 0.01 0.075 0.171 0.161

Eurasian Boreal 0.66 -0.007 0.073 0.144 0.61 -0.006 0.079 0.146 0.152

Europe 0.55 0.01 0.092 0.166 0.49 0.011 0.097 0.167 0.156

Indian Subcontinent 0.29 0.174 0.255 0.374 0.67 0.077 0.15 0.277 0.2

Insular SE Asia 0.52 -0.013 0.092 0.127 0.52 0.013 0.094 0.153 0.14

N.American Boreal 0.61 0.008 0.042 0.102 0.38 0.019 0.052 0.113 0.094

Ocean 0.64 0.002 0.04 0.092 0.63 0.008 0.04 0.098 0.09

Peninsular SE Asia 0.59 -0.016 0.208 0.345 0.68 -0.031 0.183 0.329 0.36

South America 0.02 0.022 0.054 0.067 0.48 0.005 0.029 0.05 0.045

SW Asia 0.67 -0.015 0.117 0.254 0.62 -0.027 0.125 0.242 0.269

W.CONUS 0.26 0.037 0.08 0.124 0.26 0.026 0.073 0.113 0.087

EnKF (ENAAPS-DART)Variational (NAVDAS-AOD)

Based on 6 month simulations (April – September, 2013)

Verification Against AERONET

Page 17: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Spatial Impact of Assimilation Methodology

Posterior AOT MODISAnalysis Increment

NA

VD

AS

-AO

DD

AR

T-E

nK

F

* Can capture sharper gradients in aerosol features with EnKF

Page 18: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Impact of Number of EnsemblesAERONET Sites by Region (2013)

80 Better

20 Better

Page 19: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

AERONET Sites by Region (2013)

80 Better

20 Better

Impact of Number of Ensembles

AERONET τtotal ◊ NAAPS τtotal ◊ NAAPS τsmoke

Tomsk AERONET site (56N, 84E)

AO

T

80 member20 member

Page 20: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Tomsk AERONET site (56N, 84E) 2013080206

Posterior – Prior Smoke AOT Posterior Smoke AOT

20 m

ember

80 m

ember

MODIS fire detection/AOT

Impact of Number of Ensembles

Page 21: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Smoke Emissions

Source Meteorology Met+Source

1. Bias in smoke dominated regions.

2. Meteorology ensemble helps (increase in ensemble spread), but bias still present.

3. Smoke dominated regions not well-tuned.

Ensemble Mean AOT

(To

tal

Sp

rea

d/R

MS

E)

Ensemble Mean AOT(En

sem

ble

Sp

rea

d/T

ota

l

Sp

rea

d)

1.

3.

2.

Rank Histograms of AOT (North American Boreal)

Page 22: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Impact on 24 Hour Forecast

AOT

DART-EnKFNAVDAS-AOD

Det

erm

inis

tic

En

sem

ble

*Sharpness of dust front from EnKF data assimilation is propagated in the forecast.

MODIS

AOT

Forecast Initial Condition

Fore

cast

Co

nfi

gura

tio

n

Page 23: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Current state of the ensemble system….• An ensemble aerosol system with EnKF data assimilation has

been implemented. • Bulk statistics at AERONET sites – performance is similar to

current variational system in AOT space• Capture sharper gradients with EnKF – allow for taking

advantage of increases in model resolution• This system will be used to incorporate additional aerosol

products for assimilation and to tie in source functions to assimilation system.

• Contender for transition to operations using the 80 member NAVGEM ensemble for assimilation and 20 member for forecast.

Page 24: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

80 Better

20 Better

Impact of Number of EnsemblesAERONET Sites by Region

(2013)

AO

T

AO

T 80 member

20 member

Ussuriysk AERONET site

(43N, 132E)

AERONET τtotal ◊ NAAPS τtotal ◊ NAAPS τpollution

RMSE =

0.115

RMSE =

0.127

Page 25: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Impact of Number of Ensembles

Posterior Pollution

AOT

20

mem

ber

80

mem

ber

Post – Prior

Pollution AOT

MODIS AOT

Ussuriysk AERONET site (43N, 132E)

Posterior Pollution

AOT

Post – Prior

Pollution AOT

MODIS AOT

Page 26: Development of the Ensemble Navy Aerosol Analysis ...icap.atmos.und.edu/ICAP7/Day3/NRL_DA_update_Rubin.pdfDevelopment of the Ensemble Navy Aerosol Analysis Prediction System and its

Impact of Source Ensemble

Ensemble Correlation

A)

Source

B)

Meteorology

C) Met +

Source

Ind

epen

den

t B

ore

al

Fir

es

A

B

A

B

A

B

A

B