powerpoint presentation · • overview of web site • searching for data • examples of...

NCAR is operated by UCAR under sponsorship of the NSF

5/25/2012 1


Outline • Introduction to RDA • Overview of web site • Searching for data • Examples of available data • Dataset web pages

5/25/2012 2


5/25/2012 3


5/25/2012 4


Research Data Archive (RDA) at NCAR Data Support Section • Mission - support climate & weather

research by curating, organizing, documenting, and creating access to research datasets

• To extent possible, all data and services are

free and open

5/25/2012 5


Research Data Archive (RDA) at NCAR Research Data Archive (RDA) • Established in 1960s • 600+ datasets, 4M files, 600 TB

– Every dataset has a web page • Many datasets routinely updated

– daily, weekly, monthly

• 7000 unique users annually – ~2000 from US

• ~580TBs provided in 2011

5/25/2012 6


Core Data Categories Examples of Research Areas Supported Climate Synoptic Oceanographic Hydrologic Weather Prediction Numerical Modeling Renewable Energy (Wind/Solar)

5/25/2012 7


RDA web site : rda.ucar.edu

5/25/2012 8


5/25/2012 9


5/25/2012 10


5/25/2012 11


5/25/2012 12


5/25/2012 13


5/25/2012 14


5/25/2012 15


5/25/2012 16


5/25/2012 17


5/25/2012 18


5/25/2012 19


Core Data Categories

Operational and Reanalysis model outputs

Meteorological and Oceanographic Observations

Remote Sensing Observations

Topography/Bathymetry, Vegetation, Land Use

5/25/2012 20


Meteorology/Oceanography Observations

5/25/2012 21

•141 Total Datasets •107 w/ Air Temp •77 w/ Wind •78 w/ Rainfall

Fixed Stations

•72 Total Datasets •10 w/ Water Temp •41 w/ Air Temp •8 w/ Rainfall

Ships

•Cyclone Tracks •Station Libraries •Visibility

Miscellaneous


5/25/2012 22


5/25/2012 23


Meteorology/Oceanography Observations

5/25/2012 24

•141 Total Datasets •107 w/ Air Temp •77 w/ Wind •78 w/ Rainfall

Fixed Stations

•72 Total Datasets •10 w/ Water Temp •41 w/ Air Temp •8 w/ Rainfall

Ships

•Cyclone Tracks •Station Libraries •Visibility

Miscellaneous


Platform Observations

5/25/2012 25


ICOADS

5/25/2012 26

• Marine surface and subsurface data • Ships, buoys, coastal stations and others • rda.ucar.edu/datasets/ds540.0

Description • 1662 – 2007 (rel 2.5) • 2008 – 2010 (prelim extension) • -> 2012 available

Dates • Air Temperature • Water Temperature • Salinity • Winds

Variables

• 261 million obs • Hourly to daily observations • Monthly statistics at 1x1 degree boxes

Statistics


Evolution of the Marine Climate Data System

TOTAL

5/25/2012 27



5/25/2012 28


NCAR Upper Air Database

5/25/2012 29

• Meteorological land stations • 2x (4x) daily balloon launches • rda.ucar.edu/datasets/ds370.0

Description • 1920’s to 2011 (winds only) • 1940’s to 2011 (thermal ) • 1973 -> available via web

Dates • Temperature • Moisture • Wind • Height

Variables

• 15 Standard pressure levels • Significant levels • Height above surface

Levels


0

200

400

600

800

1000

1200

1920

1925

1930

1935

1940

1945

1950

1955

1960

1965

1970

1975

1980

1985

1990

1995

# S

tatio

ns

YEAR

Stations Reporting 30 Times/ Month or More

Content of Upper Air Archive

5/25/2012 30


Station Coverage Evolution in UADB

5/25/2012 31


5/25/2012 32



5/25/2012 33


NCEP Operational Surface

5/25/2012 34

• Meteorological land stations • Observations taken 3x, 4x, 6x, 8x or 24x

daily • rda.ucar.edu/datasets/ds461.0

Description

• 1977 to 2012 Dates Range • Temperature • Moisture • Precipitation • Winds

Variables

• Global Domain


Synoptic Stations in NCEP Surface

5/25/2012 35

~ 1000 stations in North America ~ 5 obs/day per station


Metar Stations in NCEP Surface

5/25/2012 36

~ 2700 stations in North America ~ 30 obs/day per station



5/25/2012 37


GHCN Summary of the Day/Month

5/25/2012 38

• Meteorological land stations • Summary of the day and month • Web : coming soon

Description

• 1800’s to 2011 • Most stations start in 1900’s Dates

• Minimum Temperature • Maximum Temperature • Precipitation

Variables

• Global Domain


5/25/2012 39

0

5000

10000

15000

20000

25000

1850

1855

1860

1865

1870

1875

1880

1885

1890

1895

1900

1905

1910

1915

1920

1925

1930

1935

1940

1945

1950

1955

1960

1965

1970

1975

1980

1985

1990

1995

2000

2005

2010

Num

ber o

f Sta

tions

Year

Total GHCN Daily Data in US

Precip

Tmin


5/25/2012 40

Annual Precipitation Anomalies from GHCN



5/25/2012 41


U.S. and Canada Surface Hourly Data

5/25/2012 42

• Meteorological land stations • Observations 24x daily • rda.ucar.edu/datasets/ds472.0

Description

• 1977 thru 2011 Dates • Temperature • Moisture • Precipitation • Wind

Variables

• U.S. and Canada Domain


5/25/2012 43

0

500

1000

1500

2000

2500

3000 19

77

1978

1979

1980

1981

1982

1983

1984

1985

1986

1987

1988

1989

1990

1991

1992

1993

1994

1995

1996

1997

1998

1999

2000

2001

2002

2003

2004

2005

2006

2007

2008

2009

2010

2011

# of

Sta

tions

Year

Number of Stations in the U.S. and Canada Hour Data


Core Data Categories

Operational and Reanalysis model outputs

Meteorological and Oceanographic Observations

Remote Sensing Observations

Topography/Bathymetry, Vegetation, Land Use

5/25/2012 44


Operational and Reanalysis Model Output

5/25/2012 45

• Provide real time forecasts • 18 Total datasets • 2 Global Primary • 1 Regional

Operational

• 8 Projects currently archived • 6 global • 2 regional

Reanalysis

• Temperature • Moisture • Winds • Radiation • Usually well over 100/model

Variables


Featured Datasets

Operational Model Data Dataset Title Coverage Update Frequency

Thorpex Interactive Grand Global Ensemble (TIGGE) Global 2006 - Present Hourly

5/25/2012 46


TIGGE

5/25/2012 47

• Global Ensemble Forecast Data • Output from 10 different centers • Near real time (48 hours) • rda.ucar.edu/datasets/ds330.2

Description

• Oct, 2006 - > 2012 • Forecasts : 0 -> 15 days Dates Range • Temperature ~ 30 total variables • Moisture ~ 13 levels • Precipitation • Winds

Variables

• Global Domain

[email protected]

TIGGE data A phased approach was chosen beginning with mirrored data

collections of global medium-range ensemble forecasts from 10 NWP providers at three TIGGE Archive Centres: CMA, ECMWF, and NCAR.

TIGGE data is made available for research after a 48-hour delay. Near real-time access may be granted for specific projects through the THORPEX International Project Office.


TIGGE

5/25/2012 49

• Global Ensemble Forecast Data • Output from 10 different centers • Near real time (48 hours) • rda.ucar.edu/datasets/ds330.2

Description

• Oct, 2006 - > 2012 • Forecasts : 0 -> 15 days Dates Range • Temperature ~ 30 total variables • Moisture ~ 13 levels • Precipitation • Winds

Variables

• Global Domain


5/25/2012 50


5/25/2012 51


Featured Datasets



5/25/2012 52


Featured Datasets



Unidata IDD (GFS 0.5deg, RUC 20km, NAM 12km) Global and Regional 2002 - Present Daily

5/25/2012 53


UNIDATA IDD

5/25/2012 54

• Collection of model output • NCEP and ECMWF • Global and regional models • rda.ucar.edu/datasets/ds335.0

Description

• Dec, 2002 - > 2012 • Forecasts : 0 -> 16 days • Updated daily (48 hourly delay)

Dates Range • Temperature ~ 52 total variables • Moisture ~ 25 levels • Precipitation • Winds

Variables

• Global • Regional Domain


Model Analysis Forecasts # of Variables

Region

RUC2 CONUS Hourly 3 hourly -> 12 hours

16 Continental U.S. (20km)

NAM CONUS 00,06,12,18 UTC 3 hourly -> 84 hours

16 Continental U.S. (12km)

GFS 00,06,12,18 UTC 3 houlry -> 180 hours

16 Global (1 degree)

GFS 00,06,12,18 UTC 12 houlry 192 -> 384 hours

16 Global (2.5 degree)

GFS 00,06,12,18 UTC 16 Global (0.5 degree)

NCEP Regional Ensemble

00, 12 UTC 6 hourly -> 84 hours

8 North and Central America

(1.5 degree)

ECMWF 00, 12 UTC 24 hourly -> 168 hours

5 Global (2.5)

5/25/2012 55

Models in UNIDATA IDD Dataset


Featured Datasets




NCEP ETA/NAM (40km) North America 1995 - Present Monthly

5/25/2012 56


NCEP NAM

5/25/2012 57

• North American regional model • Great for WRF input • rda.ucar.edu/datasets/ds609.2

Description

• 2002 - > 2012 • Forecasts : 0 -> 60 hours • Updated monthly

Dates Range • Temperature ~ 15 total variables • Moisture ~ 35 levels • Precipitation • Winds

Variables

• North America • 40km ??

Domain


Featured Datasets





ECMWF Operational Deterministic (1.25 x 1.25 Deg) Global 1985 - Present Bi-Yearly

5/25/2012 58


ECMWF

5/25/2012 59

• ECMWF Data assimilation system • Backbone for ECMWF forecast system • rda.ucar.edu/datasets/ds113.0

Description

• 1985 - > 2011 • Updated bi-monthly Dates Range • Temperature > 60 total variables • Moisture ~ 25 levels • Precipitation • Winds

Variables

• Global • ~1.125 degree -> 2010 • .14 degree 2011 ->

Domain


5/25/2012 60


5/25/2012 61







NCEP GDAS Final Analysis (1x1 Deg) Global 1999 - Present Daily

5/25/2012 62


NCEP GDAS

5/25/2012 63

• NCEP Global Data Assimilation system • Used to initialize the GFS • Backbone for NWS forecasts

Description

• 1985 - > 2012 • Updated daily Dates Range • Temperature > 60 total variables • Moisture ~ 25 levels • Precipitation • Winds

Variables

• Global • 1.0 degree Domain


5/25/2012 64

KATRINA








5/25/2012 65








NCEP OI Global SST (1x1 Deg) Global 1981 - Present Weekly

NOAA OI Global SST (0.25 x 0.25 Deg) Global 1981 - Present Monthly

Hadley Centre Global Sea Ice and SST Global 1850 - Present Monthly

5/25/2012 66


5/25/2012 67


Reanalysis Model Output

5/25/2012 68


5/25/2012 69

Operational Model Evolution 1985 1990 1995 2000 2005 2010

Cycle R34L34

Cycle R35L34

Cycle R36L50

Cycle R37L50

Change Physics

Add Levels

New Radiation

Unknown if changes in time series caused by model discontinuities or change in climate


5/25/2012 70

Operational Model Evolution 1985 1990 1995 2000 2005 2010

Cycle R34L34

Cycle R35L34

Cycle R36L50

Cycle R37L50

Change Physics

Add Levels

New Radiation

Reanalysis R37L50

Changes in time series caused by change in climate or other factors


Featured Datasets

High Resolution Re-Analysis Dataset Title Coverage Update

Frequency Resolution Dataset ID

ERA-40 (T159) Global 1957 - 2002 Static Set ~1.125 Ds117.0

ERA-Interim (N128 Gaussian) Global 1989 - Present Yearly ~.7023 Ds627.0

1870 2011 High Resolution Re-Analysis

5/25/2012 71


Featured Datasets






5/25/2012 72


5/25/2012 73


Featured Datasets

5/25/2012 74


Featured Datasets






JRA-25 (1.125 Deg Gaussian) Global 1979 – Present Yearly ~1.125 Ds625.0

NCEP/DOE (T62) Global 1979 - Present Static Set ~ 2.0

NCEP/NCAR (T62) Global 1948 - Present Quarterly ~2.0 Ds090.0

NARR (32 x 32 km) North America 1979 - Present Quarterly 32km Ds608.0

CFSR (0.5 x 0.5 Deg) Global 1979 - Present Monthly .5 x .5 Ds093.0 Ds094.0

5/25/2012 75


Featured Datasets

5/25/2012 76


Featured Datasets






JRA-25 (1.125 Deg Gaussian) Global 1979 – Present Yearly ~1.125 Ds625.0

NCEP/DOE (T62) Global 1979 - Present Static Set ~ 2.0

NCEP/NCAR (T62) Global 1948 - Present Quarterly ~2.0 Ds090.0

NARR (32 x 32 km) North America 1979 - Present Quarterly 32km Ds608.0

CFSR (0.5 x 0.5 Deg) Global 1979 - Present Monthly .5 x .5 Ds093.0 Ds094.0

NOAA-CIRES 20th Century Global 1870 – 2008 Static Set 1.875 Ds131.1 5/25/2012 77


5/25/2012 78


Dataset Web Pages

5/25/2012 79


5/25/2012 80


5/25/2012 81


5/25/2012 82


5/25/2012 83


5/25/2012 84


SUMMARY : RDA WEB SITE : rda.ucar.edu 641 datasets covering: Meteorology and oceanographic obs Numerical Weather Output Many other datasets Email : [email protected]

5/25/2012 85

Slide Number 1Slide Number 2Slide Number 3Slide Number 4Research Data Archive (RDA) at NCARResearch Data Archive (RDA) at NCARCore Data CategoriesSlide Number 8Slide Number 9Slide Number 10Slide Number 11Slide Number 12Slide Number 13Slide Number 14Slide Number 15Slide Number 16Slide Number 17Slide Number 18Slide Number 19Core Data CategoriesMeteorology/Oceanography �ObservationsSlide Number 22Slide Number 23Meteorology/Oceanography �ObservationsPlatform ObservationsICOADS Evolution of the Marine Climate Data SystemPlatform ObservationsNCAR Upper Air DatabaseSlide Number 30Slide Number 31Slide Number 32Platform ObservationsNCEP Operational SurfaceSynoptic Stations in NCEP SurfaceMetar Stations in NCEP SurfacePlatform ObservationsGHCN Summary of the Day/MonthSlide Number 39Slide Number 40Platform ObservationsU.S. and Canada Surface Hourly DataSlide Number 43Core Data CategoriesOperational and Reanalysis Model OutputFeatured DatasetsTIGGETIGGE dataTIGGESlide Number 50Slide Number 51Featured DatasetsFeatured DatasetsUNIDATA IDDSlide Number 55Featured DatasetsNCEP NAMFeatured DatasetsECMWF Slide Number 60Slide Number 61Slide Number 62NCEP GDAS KATRINASlide Number 65Slide Number 66Slide Number 67Reanalysis Model OutputSlide Number 69Slide Number 70Featured DatasetsFeatured DatasetsSlide Number 73Featured DatasetsFeatured DatasetsFeatured DatasetsFeatured DatasetsSlide Number 78Dataset Web PagesSlide Number 80Slide Number 81Slide Number 82Slide Number 83Slide Number 84Slide Number 85

powerpoint presentation · • overview of web site • searching for data • examples of...

Documents