2018 gulf of mexico oil spill & ecosystem science conference · 2018. 2. 28. · 2018 gulf of...
TRANSCRIPT
![Page 1: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/1.jpg)
DIVER Application: Common Data Models for Data
Integration
2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference
Ben Shorr and Nick EckhardtNOAA - NOS - Office of Response & Restoration
Marti Goss & Mike PecciniNOAA - NMFS – Office of Habitat Conservation
Dan Hudgens, Ann Jones, Neal Etre, Kate DoironIEc Inc.
![Page 2: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/2.jpg)
Marsh Assessment
Oyster Collections
Telemetry Data
Shoreline Data
Water Column
Seafood Safety
Marine Mammal & Turtle Assessment
Toxicity Data
DWH Damage Assessment Data
• 20,000+ trips for field data collection
• 1 million+ field data forms and related electronic files
• 100,000+ water, tissue, oil and sediment samples
• 15 million+ database records • 30 terabytes of data• Data Referenced in many
Publications/Journals
![Page 3: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/3.jpg)
Overview
DIVER (Data Integration, Visualization, Exploration, and Reporting)
DIVER is a data warehouse and queryapplication. The DIVER approach integratesstandardized datasets so users can query
across data holdings and download information and results.
![Page 4: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/4.jpg)
http://www.gulfspillrestoration.noaa.gov/
Injury Assessment Data
Administrative Record
https://www.diver.orr.noaa.gov
![Page 5: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/5.jpg)
What is DIVER?
Processing Data Warehouse Data Access
• Query / Download• Visualization• Reporting / Analytics• Public access / Sharing• Publications (Papers)• Collaboration
Collates, standardizes and transforms
source dataStores and serves
integrated data
![Page 6: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/6.jpg)
Protocols and Standards
Field Forms(Data) Transcribe
Data Integration
Electronic Data
![Page 7: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/7.jpg)
File Collections
Metadata
Unstructured Data
Structured Data
Metadata
Digital DataForm
Metadata
Metadata
.CSV
Core
fiel
ds
Projects
Photographs
Telemetry
Ocean Data
Field Measurements/Observations
Bioassay
Samples
Metadata
![Page 8: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/8.jpg)
Common Data Models
Projects
Photographs
Telemetry
Ocean Data
Field Measurements/Observations
Data type specific models (Data Categories)
• Samples: Chemistry, biological+
• Bioassay: Toxicity testing and results
• Field Measurements and Observations:
shoreline, marsh, birds and mammals;
biological data, oil thickness
• Oceanographic: Cruise-collected sensor data
• Telemetry: Whales, dolphins, turtles, tuna
• Photography: Geolocation, Keywords
• Restoration data: Project tracking data
Core
fiel
ds
Bioassay
Samples
![Page 9: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/9.jpg)
Common Data Model(example)
Workgroup| Workplan | Data Source | Matrix | Location | Date | Form | Station |
Sample ID…
Samples
Analysis Units Depth
Bioassay
Species Endpoint Duration
Core Fields
Data Category
Detail Fields
![Page 10: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/10.jpg)
Environmental Data Specification
Data Categories
Core Fields
Detail Fields
Valid Values
Data Submission
Data Access
References/Appendices
Public DIVER website: https://www.diver.orr.noaa.gov
![Page 11: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/11.jpg)
Field Forms, Data Templates and Guidelines
![Page 12: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/12.jpg)
DIVER Data TemplatesElectronic Data Deliverables
• Chemistry and Bioassay (Toxicity)
Labs: Electronic Data Deliverables (EDDs)
• Chemistry• Bioassay (Toxicity)• Biological Data• Field Measurements and Observations
Data Providers: Electronic Data Deliverables (EDDs)
Guidance, Study Notes and Template “Tester”
• Photos Database (NOAA Photologger)• Shoreline Cleanup Assessment Techniques (SCAT)
Additional Templates
![Page 13: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/13.jpg)
Field Measurements and Observations
• Biological– Density, Productivity, Composition
• Benthic• Physical Parameters/Observation
![Page 14: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/14.jpg)
Restoration Data• $8.8 billion settlement paid
out over 15 years • Funds allocated to 7 Trustee
Implementation Groups (TIGs) across 15 resource types
• Projects will be implemented by 17 trustee agencies
• Commitment to data-driven adaptive management
Project details, activities & status
Locations Environmental compliance
Budget, receipts & expenditures
Monitoring Accomplishments
![Page 15: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/15.jpg)
Monitoring and Adaptive Management Standards
![Page 16: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/16.jpg)
Restoration Monitoring Data
![Page 17: 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference · 2018. 2. 28. · 2018 Gulf of Mexico Oil Spill & Ecosystem Science Conference. Ben Shorr and Nick Eckhardt. NOAA -](https://reader033.vdocuments.us/reader033/viewer/2022060905/60a0a76b32e8fe648c49f3f6/html5/thumbnails/17.jpg)
Because, Data.