science data systems for satellite and airborne lidar data aka – nasa lidar access system (nlas)...

19
Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby Jeff McWhirter Siri Jodha Singh Khalsa Mike Zucker Bob Stockwell Chaitan Baru Minh Phan, Vishu Nandigam Bryan Blair Michelle Hofton David Harding Claudia Carabajal

Upload: bernard-hall

Post on 17-Jan-2016

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

Science Data Systems for Satellite and Airborne LiDAR DataAKA – NASA LiDAR Access System (NLAS)

NASA ROSES Access project

Chuck MeertensChris CrosbyJeff McWhirter

Siri Jodha Singh KhalsaMike ZuckerBob Stockwell

Chaitan Baru Minh Phan,Vishu Nandigam

Bryan BlairMichelle HoftonDavid HardingClaudia Carabajal

Page 2: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

OpenTopography booth

IN31A-1499. Wednesday morning poster session. Increasing the Impact of High-Resolution Lidar Topography Through Online Data Access and ProcessingChristopher J. Crosby, et. al.

IN41C-1632. Thursday morning poster sessionRich Support for Heterogeneous Polar Data in RAMADDAJeff McWhirter, et. al.

More Information

Page 3: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

NLAS Objectives

• Integrated and simplified access to existing LiDAR data archives– Airborne (OpenTopography)– Terrestrial (UNAVCO & OpenTopography)– Large footprint airborne (NASA LVIS)– Satellite (NASA GLAS (ICESat) at NSIDC)

• Provide users access to point cloud LiDAR data, on-demand digital elevation models (DEMs) generation, and derivative products.

• Define enhanced quality control (QC) metrics data formats for IceSAT/GLAS data.

Page 4: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby
Page 5: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby
Page 6: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

-2313174.974,-3717949.974,4622885.034,4,4,4,1166-2313175.009,-3717949.961,4622885.028,2,2,2,1799-2313175.001,-3717950.058,4622884.669,2,2,2,1196-2313175.012,-3717949.889,4622884.824,4,4,4,2659

44882.2501 83.394029 302.947372 21.9063 .0003646 .0018514 9.22 260 0 109. 1 44882.2501 83.394876 302.937145 22.4024 .0018851 .0008321 23.13 349 5 -52. 3 44882.5001 83.394258 302.948768 22.0837 .0034534 .0006233 11.47 244 5 109. 1 44882.5001 83.395109 302.938469 22.1232 .0020132 -.0086983 28.39 346 2 -54. 3 44882.7501 83.394491 302.950113 21.7597 -.0048649 .0073749 12.28 244 0 107. 1

64.02431712 -41.93081856 50825.580082 0.0 1141.57328053 264.025238415 -41.929758005 50826.655015 0.0 1138.42328053 264.025546193 -41.9294137367 50827.013328 0.0 1125.4192999 2LAT LON TIME THICK

-80.799058 -93.513982 62726.2582 NaN-80.799646 -93.515586 62726.5665 NaN-80.800232 -93.517186 62726.8740 NaN

#YY MM DD hh mm DEPTH OTMP COND SAL O2% O2PPM CLCON TURB PH EH#yr mo dy hr mn m degC mS/cm psu % ppm ug/l FTU - mv2012 01 01 00 00 1.0 20.70 999.00 35.30 999.0 99.00 999.00 99 99.00 99.002012 01 01 01 00 1.0 20.70 999.00 35.30 999.0 99.00 999.00 99 99.00 99.00

Freshwater Switchyard of the Arctic Ocean 2005 Helicopter CTD ProfileCast 1 Station Alpha 29 April 2005 0829 UTC 84 deg 00.26 min North 65 deg 03.11 min West In situ Potential Depth Pres Temp Temp Cond Salinity Sigma (m) (dbar) (degC) (degC) (S/m) (psu) -theta# 3.196 3.220 -1.7430 -1.7430 2.52405 31.7839 25.5652

# data_fields: site year month day hour value unc n flag intake_ht instBRW 1973 01 01 00 -999.990 -99.990 0 I.. 0.00 N/ABRW 1973 01 01 01 -999.990 -99.990 0 I.. 0.00 N/ABRW 1973 01 01 02 -999.990 -99.990 0 I.. 0.00 N/A

Year: 2011 Month: 01 ID: BAL ARGOS: 9116 Name: Baldrick Lat: 82.78S Lon: 13.06W Elev: 1968m2011 1 1 1 0000 -18.1 765.3 3.7 281.0 83.8 444.02011 1 1 1 0300 -20.4 765.6 2.6 326.0 80.3 444.0#WOA09 JANUARY temperature Statistical mean

#COMMA SEPARATED LATITUDE, LONGITUDE, AND VALUES AT DEPTHS (M):0,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,125,150,175,200,225,250,275,300,325,350,375,400,425,450,475,500,550,600,650,700,750,800,850,900,950,1000,1050,1100,1150,1200,1250,1300,1350,1400,1450,150059.500,-179.500,2.799,2.808,2.816,2.826,2.834,2.833,2.830,2.827,2.824,2.820,2.813,2.802,2.786,2.768,2.734,2.680,2.641,2.608,2.574,2.523,2.526,2.534,2.491,2.588,2.576,3.051,3.419,3.683,3.766,3.781,3.768,3.737,3.727,3.696,3.668,3.643,3.615,3.549,3.476,3.405,3.333,3.253,3.180,3.110,3.041,2.957,,,,,,,,,,,

"TOA5","CapeBird","CR1000","38966","CR1000.Std.22","CPU:newawsFWv31_CB.CR1","42171","OutCard""TIMESTAMP","RECORD","TavgUpper","T_RTD","TavgLower","T_RTDLower","presRead","T_HMP","U_HMP","wspd_avg","wspd_res","wdir_res","wdir_std","maxws","wdirMaxWspd","TpanelAvg","solarAvg","wspdRead","wdirRead","T_panel","RawDist","SignalQuality","Dist","battVolt","Pres_us","Temp_us""TS","RN","","","","","","","","","","","","","","","","","","","","","","","","""","","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp","Smp""2011-12-02 00:20:00",0,-3.262555,-3.313211,0,0,367.8989,-2.904,80.1,2.98,2.943,242,8.77,3.704,249.6,-0.492,0,2.911,231.6,-0.522,2.534,202,2.519,13.13,30.18693,5.819439

PBO Station Position Time Series. Reference Frame : IGS08Format Version,1.0.44-character ID,P101Station name,RandolphLLUT2005Begin Date, 2005-09-03End Date, 2012-09-29Release Date, 2012-09-30Reference position, 41.6922736024 North Latitude, -111.2360162488 East Longitude, 2016.12225 meters elevation,Date, North (mm), East (mm), Vertical (mm), North Std. Deviation (mm), East Std. Deviation (mm), Vertical Std. Deviation (mm), Quality,2005-09-03,22.68, 42.87, 15.8, 1.5, 1.31, 5.23, final,

Page 7: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

An “Information-Centric” approach – Moves us from managing “documents” to managing discrete pieces of open data and

A “Shared Platform” approach –… to reduce costs, streamline development, apply consistent standards, and ensure consistency in how we create and deliver information.

A “Customer-Centric” approach – Influences how we create, manage, and present data through websites, mobile applications, raw data sets, and other modes of delivery.

Page 8: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

1 DATA AS A SERVICE (DAAS).

DaaS is clearly a common denominator and should be emphasized in program opportunities within the next two years. The goals are to provide on-demand data sharing through discovery, access, transportation, and delivery to the end user. … this should be viewed, managed, and implemented according to system engineering best practices to ensure openness and platform independence.

Page 9: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

LiDAR Data

Terrestrial LiDAR ScanningTLS

100-500 million points/daytripod1 cm footprint

Satellite - Icesat

~500 thousand points/day600 km altitude70 m footprint Airborne - LVIS

5 million points/day10 km altitude10 m footprint

Page 10: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

Consolidation of parameters from 8 GLA product files•Eliminating numerous redundant, invalid and unused parameters•Producing a single data record for each laser shotSelection of subsets from full ICESat GLA product files•Currently ~160 unique parameters in products•NLAS/GLANL 100 parameters in “long” subset for advanced users•NLAS/GLANL 18 parameters in “short” subset for casual usersDefinition of 25 additional derived parameters for improved ease of use•e.g., Conversion of waveform-derived relative range offsets to elevations Definition of 6 QA/QC parameters to guide selection of appropriate data •Source of return: Earth surface, cloud, noise, indeterminate•Cause when no geolocation result reported: no return detected, instrument anomaly•Non-nadir data acquired during spacecraft maneuver•Possible presence of forward scattering range delay•Qualitative range precision assessment from S/N and signal fitting residual•Data reliability: composite yes/no flag for 8 parameters effecting quality

ICESat Consolidated and Enhanced Altimetry Data

Page 11: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

Open Topography

NLAS Web Service

NSIDC

UNAVCO

Collection queries (ATOM)

Data access- subset, aggregation, etc

Page 12: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

RAMADDA• Data repository framework

– Freely available Java open source package– Extensible plugin architecture

• Basic content management functionality:– Create, Read, Update, Delete (CRUD)

• Access control, rich metadata, search, etc.

• Numerous output formats: RSS / ATOM, DIFF, KML, etc.

Page 13: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

NLAS Interoperabilty

NLAS/RAMADDA

Open Topography Visualization/Analysis Clients

NLAS Web Service

HTML Interface

NLAS Web Service

Page 14: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

RAMADDA Point Services Stack

LVIS IceSAT

Discrete observation data model – aggregation, subset, filtering, conversion, products

File reading framework Code generation, binary records, text formats

Data ingestMetadata

harvest

Browse, charting, mapping

NLAS data API

ATM Paris TLSMcORDS

NLAS tools – conversion, tiling

Page 15: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

Other Point FormatsAmeriflux flux towerAntarctic Meteorology Research Center (AMRC) AWS Greenland GC-NET met dataUNAVCO PBO position time seriesNOAA GMD carbon observatory and towerNOAA climate indicesCF-NetCDF point and track dataOceanographic data – Seabird CNV, glider, buoy, etcHydrology – WaterMLEtc…

Page 16: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

UNAVCO TLS Field Project Archive

Page 17: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

NASA’s ABoVE Project

Page 18: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

NSF EarthCube

IRIS Simple Web Services Building Block Project

Page 19: Science Data Systems for Satellite and Airborne LiDAR Data AKA – NASA LiDAR Access System (NLAS) NASA ROSES Access project Chuck Meertens Chris Crosby

Demo