considerations for regional data collection, sharing and exchange bruce schmidt streamnet program...
TRANSCRIPT
![Page 1: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/1.jpg)
Considerations for Regional Data Collection, Sharing and Exchange
Bruce SchmidtStreamNet Program Manager
Pacific States Marine Fisheries CommissionPresentation to
Northwest Power and Conservation CouncilJuly14, 2009
White Paper:
www.streamnet.org
![Page 2: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/2.jpg)
There’s been talk of a regional data delivery system…2000 BiOpRPA 198
2002Council Contract
with SAIC
CBCIS/ NED
2008 BiOpRPA 72
2006Col. Basin
Data CenterFish and Wildlife
Program
So why isn’t there one?NOAA
Guidance
![Page 3: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/3.jpg)
Need forShared
Data
Legal: Remand, US v OR, PST,
etc.
ESARecoveryPlanning
Coordinated Monitoring,
PNAMPPopulation
Assessments(VSP)
Inter-jurisdictionalManagement
Co-management
High Level Indicators,
SOTR
Many Programs Cross Jurisdictions
BiOpCompliance,
Listing Decisions
![Page 4: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/4.jpg)
Current data delivery status:
Existing database projects – Focused StreamNet Pacific Northwest Water Quality Data Exchange Fish Passage Center PTAGIS, RMIS, PACFIN, RECFIN IBIS (wildlife data)
Proposals – Comprehensive, but not built SAIC / CBCIS 2000 BiOp RPA 198 Columbia Basin Data Center
Efforts started – Not complete NED / PNAMP (NED Portal, ISTM) Columbia Basin Center of Knowledge (Canadian & US data)
![Page 5: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/5.jpg)
Existing database projects
Data sources: Agencies / Tribes / Projects
db db
SOTR Population modelsPopulation Assessments Subbasin planningPlanning HLIsManagement Public, etc.
db
?? ? ?
OutputTool
RegionalData
Access
DBProject
![Page 6: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/6.jpg)
Data sources: field offices, research projects, etc.
DatabaseProject
AgencyDatabase
2 6 95 3 18 7 4
2 6 95 3 18 7 4
2 6 95 3 18 7 4
Smooth, organized v. current inefficient approach
![Page 7: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/7.jpg)
Most efficient – start with existing projects:
Fish db
…Multiple types of data from multiple sources
db db db db db db
Hab. db
db
OutputTool
RegionalData
Access
Water dd
Pacific Northwest Water Quality Data Exchange
![Page 8: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/8.jpg)
Improve from there:
db
…Multiple types of data from multiple sources, standardized by data type
Water Habitat Fish
db db db db db db
dbHabitat
db
OutputTool
RegionalData
Access
dd
dbdbdbdbdb
![Page 9: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/9.jpg)
The essential driver of a comprehensive data delivery system:
db
…Multiple types of data from multiple sources, standardized by data type
Water Habitat Fish
db db db db db db
dbHabitat
db
OutputTool
RegionalData
Access
dd
dbdbdbdbdb
Data flow can be automated
![Page 10: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/10.jpg)
Automation is the key!
Efficiency, Speed Accuracy Automatic data updates Canned products Translation to regional
format Essential for any database technology
![Page 11: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/11.jpg)
Continue to evolve:
…Multiple types of data from multiple sources, standardized by data type
Water Habitat Fish
db db db db db db db db db db db db
OutputTool
RegionalData
Access
standards Standards Standards
![Page 12: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/12.jpg)
The ultimate endpoint??
…Multiple types of data from multiple sources, standardized by data type
Water Habitat Fish
db db db db db db db db db db db db
![Page 13: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/13.jpg)
How does the Data Sharing Guide help?
Organize discussions Consider ALL
components Provide a blueprint Identify needed
support
Assure that when a system is built,the data are there to deliver!
![Page 14: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/14.jpg)
The Data Sharing Guide addresses data flow
from field to highest reporting need
Non prescriptive
Any data type
Any agency
Non-technical
Primary focus is on infrastructure and
processes to assure data accessibility
![Page 15: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/15.jpg)
Previous Proposals
Vendors pitched their output tool…
but not getting data to the tool
![Page 16: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/16.jpg)
What’s needed?
1. Uninterrupted data flow, source to output
![Page 17: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/17.jpg)
Data Flow
Field data creation (local office/project)
Regional data application
Post data on the Web
Describe full data set(metadata)
Regional standards
Agency data QA / QC
Agency database system
Local use of data
Describe the data (metadata)
Quality Assurance / Quality Control
Input to electronic form
GOAL
Steps in data flow
Post metadata on the Web
Data interoperability
![Page 18: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/18.jpg)
Data Flow
Field data creation (local office/project)
Regional data application
Post data on the Web
Describe full data set(metadata)
Regional standards
Agency data QA / QC
Agency database system
Local use of data
Describe the data (metadata)
Quality Assurance / Quality Control
Input to electronic form
GOAL
Steps in data flow
Post metadata on the Web
Data interoperability
![Page 19: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/19.jpg)
Data Flow
Field data creation (local office/project)
Regional data application
Post data on the Web
Describe full data set(metadata)
Regional standards
Agency data QA / QC
Agency database system
Local use of data
Describe the data (metadata)
Quality Assurance / Quality Control
Input to electronic form
GOAL
Steps in data flow
Post metadata on the Web
Data interoperabilityAny missed step can prevent data flow!
Significant effort to bridge the gaps!
![Page 20: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/20.jpg)
What’s needed?
1. Uninterrupted data flow, source to output
2. Data validated by agency
![Page 21: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/21.jpg)
What’s needed?
1. Uninterrupted data flow, source to output
2. Data validated by agency
3. Descriptive information (metadata)
![Page 22: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/22.jpg)
What’s needed?
1. Uninterrupted data flow, source to output
2. Data validated by agency
3. Descriptive information (metadata)
4. Data and metadata on the Internet
![Page 23: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/23.jpg)
What’s needed?
1. Uninterrupted data flow, source to output
2. Data validated by agency
3. Descriptive information (metadata)
4. Data and metadata on the Internet
XMLSQL
DatabaseSpreadsheet
ASCII
Word Processing
![Page 24: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/24.jpg)
What’s needed?
1. Uninterrupted data flow, source to output
2. Data validated by agency
3. Descriptive information (metadata)
4. Data and metadata on the Internet
5. Data able to roll together
Ideal: standard data collection, definition, codes
Minimum: Data translate to a standard
![Page 25: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/25.jpg)
All of this is needed for seamless data
delivery to ANY regional tool
We can implement these steps before
deciding on a data sharing tool
![Page 26: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/26.jpg)
SamplingCrews
SamplingAgencies
FundingEntities
RegionalData Users
DatabaseProjects
PolicyMakers
RolesCreate the dataData EntryQADescribe the dataMaintain the data
Establish proceduresSet standards, codesAgency data systemsPost data / metadataBiological & data mgt. responsibilities
Negotiate key issues Metrics Methods Data dispositionContract languageSupport data automation
Set prioritiesPolicies to remove obstacles to data sharingAgency support
Technical assistanceSystem developmentData tasks for agenciesPost data & metadataFeed regional data tools
![Page 27: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/27.jpg)
So, why don’t we have a regional data delivery system?
Infrastructure to automate data flow is not in place
Focus was on the data delivery tool
Didn’t address all roles
![Page 28: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/28.jpg)
We think the Data Sharing Guide will help to:
inform development of a regional data system
avoid skipping essential components
Get us started
![Page 29: Considerations for Regional Data Collection, Sharing and Exchange Bruce Schmidt StreamNet Program Manager Pacific States Marine Fisheries Commission Presentation](https://reader030.vdocuments.us/reader030/viewer/2022032604/56649e675503460f94b6310c/html5/thumbnails/29.jpg)
Questions?
Funded by: Through:
Fish and Wildlife Program
Administered by:
www.streamnet.org