amsr-e and amsr-e validation archive & distribution status amanda leon, nsidc amsr-e lead joint...
Post on 14-Jan-2016
243 Views
Preview:
TRANSCRIPT
AMSR-E and AMSR-E ValidationArchive & Distribution Status
Amanda Leon, NSIDC AMSR-E Lead
Joint AMSR-E Science Team Meeting
Hunstville, Alabama2-3 June
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 20102
Outline
AMSR-E• Product Status• Data Support • Metrics• Accomplishments & Plans
AMSR-E Validation• Status• Metrics
Sea ice derived from the AMSR-E 89 GHz Tbs. Image courtesy
of NASA/GSFC Visualization Studio
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 20103
Product Status
• V04 L3 Ocean release (May
’10) and reprocessing (on-going)
• V12 Sea Ice release and reprocessing (April - May ’10)
• L3 Land, Sea Ice, & Snow to validated Version 2 using V10 L2A reprocessing (July ’09)
AMSR-E Data Versions: http://nsidc.org/data/amsre/versions.html
Average ice sheet surface temperature over Greenland from August 5 through August 13, 2005 using AMSR-E 6.25 Tbs and 12.5 km sea ice products. Image courtesy of NASA/GSFC Visualization Studio.
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 20104
Data Support: Data AccessWarehouse Inventory Search Tool (WIST)• Search/order from ECHO metadata database• https://wist.echo.nasa.gov/~wist/api/imswelcome
Data Pool• On-line access to entire archive• http://nsidc.org/data/data_pool/
Data Subscriptions• http://nsidc.org/daac/subscriptions.html
Preliminary (NRT) Data• L2 & L3 products • http://nsidc.org/data/amsre/prelim.html
http://nsidc.org/data/amsre/order_data.html
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 20105
Data Support: Data Access
Easier to get to AMSR-E data on NSIDC web site – fewer clicks.
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 20106
Data Support: Documentation & USOhttp://nsidc.org/data/amsre/data_summaries/index.htmlDocumentation
• Comprehensive product documentation• Algorithm version information
User Services• Provide support of data products, in-house developed tools, and
proprietary software
• Coordinate product announcements, outreach materials, and NSIDC presence at meetings
Published Research • Citations updated annually
Please email any additions or corrections to Amanda.Leon@nsidc.org or nsidc@nsidc.org
Added an ATBD section
http://nsidc.org/data/amsre/research.html
nsidc@nsidc.org
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 20107
Archive MetricsTotal Archive: 18 TB
Total Version 2 Archive: 9 TB
18 June 2002 – 30 April 2010
Stats from EMS
Product GBs
AE_5DSNO 1.13
AE_DYOCN 34.11
AE_DYSNO 5.70
AE_L2A 4218.21
AE_LAND 57.49
AE_LAND3 171.73
AE_MOOCN 1.13
AE_MOSNO 0.19
AE_OCEAN 476.43
AE_RAIN 882.90
AE_RNGD 0.01
AE_SI12 164.88
AE_SI25 54.34
AE_SI6 123.05
AE_WKOCN 4.92
AMSREL1A 3032.05
Total 9228.28
Version 2 Archive Volume
0
1000
2000
3000
4000
5000
6000
2002 2003 2004 2005 2006 2007 2008 2009 2010
Vol
ume
(GB
)Version 1 Version 2 Total
Switch to Version 2
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 20108
Distribution Metrics: Total18 June 2002 – 30 April 2010
Stats from EMS
Total Distribution:329.48 TBs
10.2 million files
AMSR-E sea surface temperatures in the Gulf of Mexico on 29 May 2009. Image courtesy of NASA/GSFC Visualization Studio.
Data Type Files Volume (GB)
AE_5DSNO 43371 76.80211
AE_DYOCN 51302 562.2645
AE_DYSNO 276492 483.1743
AE_L2A 4388018 243388.9
AE_LAND 1171058 713.5345
AE_LAND3 704225 33265.71
AE_MOOCN 1645 15.37441
AE_MOSNO 8908 14.10229
AE_OCEAN 848980 8991.692
AE_RAIN 1699439 13956.12
AE_RNGD 3139 0.212054
AE_SI12 322820 15143.6
AE_SI25 110634 1692.644
AE_SI6 128038 4803.416
AE_WKOCN 3488 29.15175
AMSREL1A 414139 14245.87
Total 10175696 337382.5
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 20109
Distribution Metrics: Trends2004 - 2010 File Distribution
Stats from EMS
Growth
2004-2005113%
2005-2006116%
2006-2007-25%
2007-200826%
2008-2009100%
302184 332369
874314561729
704166
1337034
251970
127411
457444
307185
222507
537633
0
500000
1000000
1500000
2000000
2500000
3000000
2004 2005 2006 2007 2008 2009 2010
AMSREL1A
AE_WKOCN
AE_SI6
AE_SI25
AE_SI12
AE_RNGD
AE_RAIN
AE_OCEAN
AE_MOSNO
AE_MOOCN
AE_LAND3
AE_LAND
AE_L2A
AE_DYSNO
AE_DYOCN
AE_5DSNO
381,897
814,779
1,766,343
1,314,039
1,657,879
3,325,423
864,340
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201010
Distribution Metrics: Trends2004 - 2009 Volume Distribution
Stats from EMS
Growth
2004-200557%
2005-200697%
2006-2007-0.2%
2007-200861%
2008-200950%
11770.07 15177.22
37136.91 34356.60
55704.22
76351.78
12050.46
0.00
20000.00
40000.00
60000.00
80000.00
100000.00
2004 2005 2006 2007 2008 2009 2010
AMSREL1A
AE_WKOCN
AE_SI6
AE_SI25
AE_SI12
AE_RNGD
AE_RAIN
AE_OCEAN
AE_MOSNO
AE_MOOCN
AE_LAND3
AE_LAND
AE_L2A
AE_DYSNO
AE_DYOCN
AE_5DSNO
15,100
23,750
46,777 46,643
75,314
113,082
29,147
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201011
Distribution Metrics: Data Access Method
Stats from EMS
0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
80.00%
90.00%
100.00%
2004 2005 2006 2007 2008 2009 2010
SUBSCRIPTION - SCP
SUBSCRIPTION - FTPPULL
SUBSCRIPTION - FTPPUSH
DLT
DATAPOOL
DVD
CDROM
FTPPUSH
FTPPULL
Data access based on distributed data volume.
Overall:
ECHO/EDG orders = 46.29 %Data Pool downloads = 48.93%
Subscriptions = 4.78%
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201012
Distribution Metrics: Users18 June 2002 – 30 April 2010
41 % - U.S. Users
59% - Foreign Users
Stats from EMS & USO TRAK Database
~2527 DistinctAMSR-E Users
User TypeDistinct Users
FOREIGN COMMERCIAL 41
FOREIGN GVMT 195
FOREIGN K-12 2
FOREIGN OTHER 590
FOREIGN UNIVERSITY 663
NASA 151
NOAA 42
US COMMERCIAL 52
US FEDERAL GVMT 52
US GENERAL PUBLIC 10
US GOVERNMENT 18
US K-12 5
US OTHER 86
US STATE/LOCAL GVMT 12
US UNIVERSITY 555
ECS OTHER 49
WDC 2
OTHER 2
Data TypeDistinct Users
AE_5DSNO 442
AE_DYOCN 220
AE_DYSNO 519
AE_L2A 2115
AE_LAND 604
AE_LAND3 1269
AE_MOOCN 92
AE_MOSNO 235
AE_OCEAN 450
AE_RAIN 471
AE_RNGD 163
AE_SI12 821
AE_SI25 341
AE_SI6 320
AE_WKOCN 82
AMSREL1A 280
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201013
Distribution Metrics: Users
Stats from USO TRAK Database
2003 – 2010 Total Distinct Users per Year
108
298
675
609
282
471
517
597
0
100
200
300
400
500
600
700
800
2003 2004 2005 2006 2007 2008 2009 2010
Dis
tin
ct
Us
ers
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201014
Distribution Metrics: Preliminary Data
Preliminary (NRT) L2 & L3 Distribution through 30 April 2010
Users have doubled since last June. AE_L2A increased by 521 users.
Statistics from our University FTP logs
NRT 12.5 km Sea Ice concentration data in Google Earth for 20 June 2009.
ProductDistinct Users Files
Volume (MB)
AE_DyOcn 29 217 2306.758
AE_DySno 68 14494 29712.48
AE_L2A 786 8653980 14567323
AE_Land 97 22746 15240.27
AE_Land3 184 5646 266266.5
AE_Ocean 63 31035 377279.7
AE_Rain 36 5454 55254.48
AE_SI12 69 12585 388000.2
AE_SI25 51 2106 42517.4
AE_SI6 63 1269 54700.05
Total 1194 8750323 15799811
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201015
Accomplishments & PlansAccomplishments • NRT L3 soil moisture in Google Earth
30/60/90 day animations http://nsidc.org/data/virtual_globes/index.html
• Data Stories Katrina - SST http://nsidc.org/data/amsre/image_gallery/index.html
• QA, PH & Browse files Now searchable and orderable from WIST and DataPool
• AMSR-E related data sets Co-Registered AMSR-E, QuikSCAT, and WMO Data (Marco Tedesco) Daily Global Land Surface Parameters Derived from AMSR-E (John Kimball) Canadian Meteorological Centre (CMC) Daily Snow Depth Analysis Data (Ross
Brown)
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201016
Accomplishments & PlansL3 Soil Moisture for 25 May 2010
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201017
Plans• Sea Ice reprocessing for ice concentration difference
issue: documentation updates, user notice
• Sea ice drift product: documentation, ingest testing, public release
• 2007 sea ice minimum data story
• Hopefully integrate LANCE with preliminary data stream
• Integrate ECS data discovery with NSIDC’s Searchlight interface
Accomplishments & Plans
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201018
AMSR-E Validation: Status
• Have published all validation data held at NSIDC! Used new low level of effort process. Published 50 data sets in 2009.
• We welcome any additional validation data that PIs have Northern Manitoba Regional Snow
Surveys for AMSR-E Field Validation (Chris Derksen)
GAPS09 & GAPS10 (Marco Tedesco)?
CryosphereAMSRIce03AMSRIce06
CLPxMeltpond 2000 Puenta Arenas
East Antarctic Sea IceWest Antarctic Sea Ice
Sea of Okhostk
RainfallBALTEX
Eureka, CAIowa City, IAWakasa Bay
Soil MoistureSMEX02 SMEX03
SMEX04-NAMESMEX05
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201019
AMSR-E Validation: Metrics
0
2
4
6
8
10
12
14
16
18
20
2003-2Q
2003-4Q
2004-1Q
2004-2Q
2004-3Q
2004-4Q
2005-1Q
2005-3Q
2005-4Q
2006-1Q
2006-2Q
2006-3Q
2006-4Q
2007-1Q
2007-4Q
2008-1Q
2008-2Q
2008-3Q
2008-4Q
2009-1Q
2009-2Q
2009-3Q
2009-4Q
2010-1Q
2010-2Q
Dat
a se
ts p
ublis
hed
Data sets published by quarter.
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201020
AMSR-E Validation: Metrics
5.1
476
94
0
50
100
150
200
250
300
350
400
450
500
Rainfall Cryosphere Soil Moisture
Archive volume (GB) on disk as of 26 May 2010.Total Archive Volume = 575.1 GB
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201021
AMSR-E Validation: MetricsDistinct users from FTP site through 30 April 2010.
Total Distinct Users = 3,714
1,444
1,940
330
0
500
1000
1500
2000
2500
Rainfall Cryosphere Soil Moisture
Statistics from our University FTP logs
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201022
AMSR-E Validation: MetricsFiles download from FTP site through 30 April 2010.
Total Files Distributed = 627,596
Statistics from our University FTP logs
204,839
402,613
20,144
0
50000
100000
150000
200000
250000
300000
350000
400000
450000
Rainfall Cryosphere Soil Moisture
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201023
AMSR-E Validation: Metrics
Volume (GB) downloaded from FTP site through 30 April 2010.Total Volume Distributed = 1,647.47 GB
Statistics from our University FTP logs
105.80
629.63
912.04
0.00
100.00
200.00
300.00
400.00
500.00
600.00
700.00
800.00
900.00
1000.00
Rainfall Cryosphere Soil Moisture
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201024
AMSR-E Team at NSIDC
Thanks to the AMSR-E Teams at NSIDC!
AMSR-E
Chris Bond – Operations
Karla LeFevre – Technical Writer
Lisa Booker – User Services
Jeff Smith – Programmer
Siri Jodha Khalsa – ECS Science Coordinator
Walt Meier – Scientist
Doug Fowler – Test Engineer
Cathy Fowler – Database Administrator
AMSR-E Validation
Chris Bond – Operations
Karla LaFevre – Technical Writer
Dan Webster – Technical Writer
Lisa Booker – User Services
Jeff Smith – Programmer
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201025
Backup Slides
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201026
AMSR-E Activities at NSIDC
• Redesigned AMSR-E Web site http://nsidc.org/data/amsre/index.html
• Google Earth 30/60/90 day NRT 12.5 km sea ice concentration and extent animations http://nsidc.org/data/virtual_globes/index.html
• NRT12.5 km sea ice images used by Science on a Sphere http://nsidc.org/data/virtual_globes/index.html
• QA files should be available to users in January 2010
Joint AMSR-E Science Team Meeting
Amanda Leon - NSIDC DAAC 2-3 June 201027
top related