1 of 32 systematic planning for environmental decision-making doe em-3 day 2 dqo training colorado...
TRANSCRIPT
![Page 1: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/1.jpg)
1 of 32
Systematic Planning for Environmental Decision-Making
DOE EM-3 Day 2 DQO Training
Colorado Department of PublicHealth & Environment
EPA Conference CenterRocky Mountain Room
999 18th Street Denver, CO 80202
Wednesday, October 30, 2002
![Page 2: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/2.jpg)
2 of 32
Introduction, Objectives, and Agenda
Presenter: Sebastian Tindall
Day 2 DQO Training CourseModule 0
(15 minutes)
![Page 3: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/3.jpg)
3 of 32
Make defensible decisions by managing uncertainty via systematic planning
EM-3 DQO Mission:
Introduction
Institutionalize the standardized Data Quality Objectives (DQO) Process (systematic planning) throughout the Department of Energy (DOE) complex
![Page 4: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/4.jpg)
4 of 32
Day 2 Course Objectives Learn
– “How to” for each activity in each of the 7 steps of the DQO Process
– Basic statistical concepts using hands-on examples and computer simulations
– How to manage uncertainty in the sampling and analysis design process
– New Environmental Protection Agency (EPA) “TRIAD” approach for implementation of sampling
![Page 5: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/5.jpg)
5 of 32
The TRIAD ApproachThe TRIAD Approach
Systematic Planning
Dynamic Work Plans
Real-Time Measurement Technologies
![Page 6: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/6.jpg)
6 of 32
Important “How To” Concepts
Scoping is the most important activity Poor scoping promotes distrust between
regulators and facility managers Using an independent facilitator who has
technical knowledge promotes agreement between different opinions
Interviews with decision makers promote consensus and resolution of global issues
![Page 7: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/7.jpg)
7 of 32
Global issues are those that do not require data to resolve but are crucial for success
Important “How To” Concepts (cont.)
Global issues are those that include interpretation of regulations
Resolution of global issues ensures technical staff resolve disagreements between decision makers prior to developing sampling designs
Good decisions require defensible sampling and analysis designs
![Page 8: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/8.jpg)
8 of 32
Statistical Concepts
Generate frequency distributions Transform data from numerical to graphical Generate histograms Generate Probability Density Functions Evaluate error consequences versus target
error rates Evaluate error rates & number of samples
versus cost of analysis
![Page 9: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/9.jpg)
9 of 32
How Many Samples do I Need?
REMEMBER:
HETEROGENEITY
IS THE RULE!
![Page 10: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/10.jpg)
10 of 32
Remember
Population is the TOTAL universe of objects within the decision unit
THUS
The only way to make decisions without errors is to take a CENSUS
Can’t sample or “measure” the ENTIRE site Population must therefore be sampled
representatively
![Page 11: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/11.jpg)
11 of 32
Uncertainty is additive!Analytical
+ Sub-sampling
+Natural heterogeneity of the site
=Total Uncertainty
![Page 12: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/12.jpg)
12 of 32
Errors
![Page 13: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/13.jpg)
13 of 32
To Control Sampling Error
Control sub-sampling methods and sample mixing methods
Take larger sample volumes Reduce particle size Specify methods that fit the sample size
and particle size Increase sample density by performing
more on-site, rapid analyses
![Page 14: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/14.jpg)
14 of 32
![Page 15: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/15.jpg)
15 of 32
Sampling heterogeneity decreases as sampling density
increases.
REMEMBER:
How Many Samples do I Need?
![Page 16: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/16.jpg)
16 of 32
The following slides show today’s agenda with the content
and times of each module
![Page 17: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/17.jpg)
17 of 32
The EPA 7-Step DQO Process
Step 1 - State the Problem
Presenter:Sebastian Tindall
Day 2 DQO Training CourseModule 1
(60 minutes)(15 minute Morning Break)
![Page 18: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/18.jpg)
18 of 32
The EPA 7-Step DQO Process
Step 2 - Identify the Decisions
Presenter: Sebastian Tindall
(15 minutes)
Day 2 DQO Training CourseModule 2
![Page 19: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/19.jpg)
19 of 32
The EPA 7-Step DQO Process
Step 3 - Identify Inputs
(45 minutes)
Presenter:
Sebastian Tindall
Day 2 DQO Training CourseModule 3
![Page 20: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/20.jpg)
20 of 32
The EPA 7-Step DQO Process
Step 4 - Specify Boundaries
(30 minutes)
Presenter:
Sebastian Tindall
Day 2 DQO Training CourseModule 4
![Page 21: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/21.jpg)
21 of 32
The EPA 7-Step DQO Process
Step 5 - Define Decision Rules
(15 minutes)
Presenter: Sebastian Tindall
Day 2 DQO Training CourseModule 5
![Page 22: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/22.jpg)
22 of 32
The EPA 7-Step DQO Process
Step 6 - Specify Error Tolerances
(40 minutes)
Presenter: Sebastian Tindall
Day 2 DQO Training CourseModule 6
![Page 23: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/23.jpg)
23 of 32
The EPA 7-Step DQO Process
Step 7 - Optimize Sample Design
(70 minutes)
Presenter:
Sebastian Tindall
Day 2 DQO Training CourseModule 7
![Page 24: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/24.jpg)
24 of 32
Closing Remarks
Presenter: Sebastian Tindall
(10 minutes)
Day 2 DQO Training CourseModule 8
![Page 25: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/25.jpg)
25 of 32
The EPA 7-Step DQO Process
Statistical Concepts and Demonstrations
Presenter: Chuck Ramsey
Day 2 DQO Training CourseExercises
![Page 26: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/26.jpg)
26 of 32
• Appendix A: – Thomas Grumbly DOE DQO directive,
September 1994
• Appendix B:
– Timothy Fields EPA OSWER directive, June 1999
• Appendix C:
– Expedited Site Characterization Field Quality Assurance Meeting minutes, January 1994
Note: Appendices have been removed from the binders but can be found on our web site:
http://www.hanford.gov/dqo/training/contents1.html
![Page 27: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/27.jpg)
27 of 32
• Appendix D: Effective Data– Deana Crumbling, U.S. EPA-HQ
• ES&T: Managing Uncertainty…
• White Paper: Triad Approach…
• White Paper: Applying Effective Data...
• White Paper: Relationship: SW-846, PBMS... • White Paper: Clarifying DQO Terminology…
– Dr. Bart Simmons, CAL/EPA DTSC• Using Field Methods: Court decisions
– Dr. Al Robbat, Tufts University• Dynamic Work Plans & Field Analytics
– Sebastian Tindall, BHI
• ESC M-Cubed Approach
• Culture Change Flow Chart
![Page 28: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/28.jpg)
28 of 32
• Appendix E: – List of Acronyms and Symbols used in course
materials
• Appendix F:
– U.S. EPA ORDER 5360.1 A2 CHG 2 May 5, 2000
(http)://www.hanford.gov/dqo/training/contents1.html)
![Page 29: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/29.jpg)
29 of 32
We want to help you:
Do it!Do it!(Get the job done - right)
Prove it!Prove it!(Document what/why/how)
CertifiedCertified
![Page 30: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/30.jpg)
30 of 32
Final Exam Preview
• Old answer - A painful elaboration of the obvious
• Hint: Answer has 3 items
What is the DQO Process in a Nutshell?
![Page 31: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/31.jpg)
31 of 32
NAMP DQO TRAINING, Part 1 – CAL/EPA DTSCCOURSE/INSTRUCTOR EVALUATION FORM
Course Title: Managing Uncertainty and Improving the Decision-Making Process
Module 1: ___________________
Instructor: Sebastian Tindall
Date:
Time:________________
Please check your assessment of the following statements:
Range: 5= completely agree 1 = disagree 5 4 3 2 1
1. The objectives of the module were understood and accomplished
2. There was adequate coverage of the subject matter
3. The subject matter was organized
4. The instructional tools were appropriate and organized
5. Enough time was allocated to cover module material
6. The instructor was effective
8. I would recommend the module to colleagues
If recommended, to whom:________________________________
9. What did you like best about the module? List the strong points.
______________________________________________________________________________________
______________________________________________________________________________________
10. What would you change? Are there any improvement opportunities?
______________________________________________________________________________________
______________________________________________________________________________________
11. What was one thing (insight, learning) you found of most value?
______________________________________________________________________________________
______________________________________________________________________________________
12. Was there enough time to cover the material? If no, please explain.
______________________________________________________________________________________
______________________________________________________________________________________
13. Any constructive feedback for the instructor?
______________________________________________________________________________________
______________________________________________________________________________________
Name (Optional):________________________________________________________________________
![Page 32: 1 of 32 Systematic Planning for Environmental Decision-Making DOE EM-3 Day 2 DQO Training Colorado Department of Public Health & Environment EPA Conference](https://reader035.vdocuments.us/reader035/viewer/2022062423/56649efc5503460f94c0fa03/html5/thumbnails/32.jpg)
32 of 32
End of Module 0
Thank you