1Dec. 8, 1997

LEADS Quality Assurance Summary

Robert Brewer(512) 239-1618

Monitoring Operations Division Network QA Manager

2Dec. 8, 1997

Introduction

What is Quality? How do you measure it? How do you get it?

3Dec. 8, 1997

Quality

- Quality is the sum of features and properties/characteristics of a process, item, or service that bears on its ability to meet the stated needs and expectations of the user. (EPA definition)

- Quality Assurance is an integrated system of activities designed to achieve quality products.

4Dec. 8, 1997

(Data) Quality Measures

Accuracy Precision Completeness Comparability Representativeness

5Dec. 8, 1997

How is Quality Assured?

Planning and Organization (Who does What, When, Where, Why, and How)

Documentation and Training Use and Maintenance of Appropriate Sampling and

Analysis Methods Measurement Traceability to Authoritative Standards

(NIST) Quality Control Checks Data Validation Data Quality Assessment Corrective Action

6Dec. 8, 1997

TNRCC Quality Management Plan

NAMS/SLAMS/PAMS QA Project Plan Other QAPPs

Manuals SOPs

QA ManualCAMS ManualCAMS Preventative

Maintenance Instruction Manual

LEADS 001 - Datalogger (Zeno Model B), Operation and Troubleshooting

LEADS 002 - Calibrator (DASIBI 5008), Operation and Troubleshooting

LEADS 006 - Standardization of CAMS Span Sources (DASIBI 5008)

LEADS 007 - Span Source Audit of Calibration Systems (DASIBI 5008)

Etc.

Documentation

7Dec. 8, 1997

Quality Assurance Project Plan (QAPP) Contents

Title and Approval Sheet Table of Contents Distribution List Project/Task Organization Problem Definition/Background Project/Task Description Data Quality Objectives (DQO) for Measurement Data Special Training Requirements/Certifications Documentation and Records Sampling Process Design (Experimental Design) Sampling Methods Requirements Sample Handling and Custody Requirements Analytical Methods Requirements Quality Control (QC) Requirements

8Dec. 8, 1997

QAPP Contents (cont.)

Instrument/Equipment Testing, Inspection, and Maintenance Requirements

Instrument Calibration and Frequency Inspection/Acceptance Requirements for Supplies and Consumables Data Management Assessments and Response Actions Reports to Management Data Review, Validation, and Verification Requirements Validation and Verification Methods Reconciliation with Data Quality Objectives

9Dec. 8, 1997

Measurement Traceability

OzoneNO, NO2, NOx, SO2, H2S, COLevel

MO Cal Lab UV Photometer

DASIBI 5008 Calibrator (O3 Generator)

Flow

MO Cal Lab Primary Flow Standards

NIST Gas Standards

CAMS Gas Standards

DASIBI 5008 Calibrator (NO, SO2, H2S, CO)

1

2

CAMS O3 MonitorCAMS NO, SO2, H2S, & CO Monitors

3

10Dec. 8, 1997

Quality Control Checks During Calibrations

Monitor Voltage and Concentration Outlier Checks Concentration Spacing Check Slope/Intercept Checks Zero/Span Checks Precision/Linearity Check Converter Efficiency Checks (NOx & H2S)

During Span Checks Monitor Voltage and Concentration Outlier Checks Concentration Spacing Check Zero/Span Checks Linearity Check Converter Efficiency Checks (NOx & H2S)

Span Source Audit - Checks the accuracy of the DASIBI 5008 Calibrator every 45 days

11Dec. 8, 1997

Data Validation

LEADS Automatic Data Validation Meteorological Parameter checks Multiple Parameter Validity checks Negative Data Check Validation based on Quality Control check results

LEADS Manual Validation Human review of data Graphical display of data versus time Validator can select suspect data and apply appropriate

validation codes or apply a different calibration slope and/or intercept

12Dec. 8, 1997

Data Quality Assessment

Accuracy - From Monitor Performance Audits once a year. Assessed in three concentration ranges for each pollutant monitor.

Precision - From the weekly Precision Check. The T-level concentration of the Span Check provides this data.

Completeness - % Data Return achieved by each monitor during a calendar quarter.

Data Quality Objectives - Stated in the QAPP

13Dec. 8, 1997

Corrective Action

LEADS Automatic Corrective Action - Data invalidated if Calibration or Span Checks Fail.

Daily Status Reports (Web Pages) provide calibration and span check results, and other information needed to determine the need for corrective action.

14Dec. 8, 1997

Conclusion

Everyone involved in a monitoring project is responsible for some aspect of quality assurance. Working together we can meet or exceed our quality goals.

15Dec. 8, 1997

QA Contacts

Marie Streusand - NAMS/SLAMS QA Officer. Responsible for the QAPP. (512) 239-2610

Bob Watson - Monitoring Operations Calibrations Laboratory Manager. Responsible for calibration of the DASIBI 5008, gas cylinders, O3 transfer standards, and flow meters. (512) 239-1876

Bob Schultz - Audits CAMS. Trains and certifies QA personnel. (512) 239-1653

Dewayne Ehman - Audits CAMS. Reviews Span Source Audit reports. (512) 239-1671

Robert Brewer - Monitoring Operations Division Network QA Manager. (512) 239-1618