by anwar sutan - i-vigilant...by anwar sutan agenda • objectives • regulation requirements •...

57
Review of ISO10723 Performance Test Frequency By Anwar Sutan

Upload: others

Post on 05-Jun-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Review of ISO10723 Performance Test Frequency

By Anwar Sutan

Page 2: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Agenda

• Objectives

• Regulation Requirements

• Issues in analyzer system

• ISO 10723 Intention and Practices

• Case Studies

• Alternative method

• ISO 10723 – other method comparison

• Summary

Page 3: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Objectives

• To discuss the possibility of reducing ISO 10723 Performance test freq

• To consider other “Health Checks” to catch in-year GC issues

Page 4: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

REGULATORY REQUIREMENTS

Page 5: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Regulatory Requirements (EU ETS)

• The commission of the European communities decision 18/7/2007

• Commission Regulation 601/2012 on the monitoring and reporting of greenhouse gas emissions– It does not mention ISO 10723 anymore

Page 6: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Regulatory Requirements (EU ETS)

• Regulation from 2007 is much more quoted in comparison to the regulation from 2012

• Or

• Wording validation is interpreted as ISO 10723 Performance Test

Page 7: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Regulatory Requirements (EU ETS)

• Determination of Calculation Factors based on analyses:– Use of laboratories

– Use of online gas chromatograph

– Use of offline chromatograph

PrecedenceOperators who determine calculation factors using laboratories did not get any audit points

Page 8: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Regulatory Requirements (EU ETS)

• When using laboratory for calculation factors determination:

– There is minimum frequency of analysis in terms of sampling plan

Page 9: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Regulatory Requirements (EU ETS)

• Different frequency is allowed if:

– Based on historical data, any variation does not exceed 1/3 of the uncertainty value to which operator has to adhere to

– Using the required frequency would incur unreasonable cost

Page 10: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Regulatory Requirements (DECC Guideline)

• DECC Guideline Issue 9

– 7.5.8. DECC may require operators of relevant systems to quantify at regular intervals the linearity and repeatability of fiscal gas chromatographs

– 7.6. The gas chromatograph should be subject to a ‘health check’, the frequency of which may be determined on a ‘risk-based’ analysis. DECC may insist on ISO 10723 certification

– 7.5.9. Calibration gas should lie within linear response of the analyser

Page 11: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

ISSUES IN ANALYSERSYSTEM

Page 12: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Issues in Analyzer System

Pressure Let Down System

Heavy end drop out

GC

Linearity and repeatability, leakage etc

Ca

l gas

Stratification / high uncertainty cal gas

Human Error / Procedure

Page 13: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Issue Sensitivity

Issue Errors found

Heavy end drop out in PLS More than £150K /month (0.8%)

Calibration gas error More than £50K /month (0.35%)

Human error More than £300K /month (1.4%)

Linearity from GC (Up to 20% difference in Methane) 0.075% in CV (Acceptable CV uncertainty of 0.2%)

Page 14: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Validation / Health Check

Page 15: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

ISO 10723 INTENTION AND PRACTICES

Page 16: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

ISO 10723 INTENTION

• To quantify GC repeatability

• To quantify GC linearity

• To determine GC Performance benchmark– Errors (bias)

– Uncertainties (from calibration gas and repeatability)

– Overall bias Combination of errors and uncertainty

• Overall to validate that GC is working correctly (Health Check)

• There is no calibration being done during this process

Page 17: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Current ISO 10723 Practices

• Many operators do it once a year / once every two years

• Range of gas is very often not as per actual concentration

Page 18: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Current ISO 10723 Practices

• Linearization constants are seldom implemented (only 4 out of 30 GC on case study has multilevel calibration constant applied)

• Some GC don’t have these feature inside the GC

Page 19: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Current ISO 10723 Practices

• The benchmark is only valid if the GC maintains performance characteristics measured on the day of calibration

• Many operators send a GC specialist prior to ISO 10723 test

• Extra cost

Page 20: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

CASE STUDIES

Page 21: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case study

• Two tracking GC of which one failed ISO 10723 test

• MLC constants applied vs single point calibration mole%

• Errors masked by polynomial curve

• ISO 10723 test – GCAS – ISO 10723 test

Page 22: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 1

• Performance test failed outside the actual gas range

Page 23: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 2

• MLC mole% vs single point calibration mole%

Page 24: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 2

• MLC mole% vs single point calibration mole%

Page 25: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 2

• MLC mole% vs single point calibration mole%

Page 26: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 2

• MLC mole% vs single point calibration mole%

Page 27: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 2

• CV and Relative Density

Page 28: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 2

• CV and Relative Density

Page 29: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 2

• CV and Relative Density

Page 30: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 2

• CV and Relative Density

Page 31: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 3

• ISO 10723 Performance check may be performed on Chromat with:

– Valve timing error

– Peak cuts

The benchmark is only valid if the GC maintains performance characteristics measured on the day of calibration

Page 32: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 3

• ISO10723 Polynomial constants are formed under faulty conditions

• Errors are masked by polynomial curve

Page 33: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 4

• ISO10723 – GCAS monitoring – ISO10723 was done

Page 34: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 4

• ISO10723 – GCAS monitoring – ISO10723 was done

Page 35: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Case Study 4

• Could we reduce the ISO 10723 test frequency in this case?

Page 36: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

WHAT IS THE ALTERNATIVE?

Page 37: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

i-Vigilant’s GCAS Method

Page 38: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

What is the method?

• Footprint and calibration data

Ascending trends and high correlation ensures correctness of calibration gas as well as events timing in GC

Page 39: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

What is the method?

• Uncertainty monitoring

Uncertainty limit can be set to flag an alarm when limit is reached

Page 40: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

What is the method?

• Last calibration data update monitoring

When data is not updated it’s an indication that GC calibration has failed

Page 41: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

In a Nutshell

Page 42: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

GCAS GC Validation

• Valve timing correctness

• Calibration gas correctness

Page 43: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

GCAS GC Validation

• Valve timing correctness

• Calibration gas correctness

• Control chart

Page 44: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

GCAS GC Validation

• Valve timing correctness

• Calibration gas correctness

• Control chart

• Uncertainty calculation

Page 45: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

GCAS GC Validation

• Valve timing correctness

• Calibration gas correctness

• Control chart

• Uncertainty calculation

• Spot sampling checks

Page 46: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

GCAS GC Validation

• Valve timing correctness

• Calibration gas correctness

• Control chart

• Uncertainty calculation

• Spot sampling checks

• Fully auditable comments

Page 47: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Issues in Analyzer System

Pressure Let Down System

GC

Ca

l ga

s

RISK BASED

Page 48: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Other Validation Method

• GC calculated density vs densitometer measured density

• GC calculated VOS vs USM measured VOS

Page 49: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

ISO10723 vs GCAS

• The only health check / validation feature that’s missing in GCAS is linearity determination

• Density or VOS comparison is additional set of validation that can be used• ISO 10723 to determine GC linearity

Page 50: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

CONCLUSION

Page 51: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies
Page 52: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Where the following conditions are met:– Initial ISO 10723 has been done on well maintained GC

Page 53: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Where the following conditions are met:– Initial ISO 10723 has been done on well maintained GC

– Actual measurement bias are within acceptable limit

Page 54: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Where the following conditions are met:– Initial ISO 10723 has been done on well maintained GC

– Actual measurement bias are within acceptable limit

– GC proves to be reproducible throughout the year (low uncertainty)

Page 55: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

When Do We Need to do ISO10723 Performance Test?

• DECC Guideline: ‘risk-based’ analysis

• Error exposure if it’s not being done

• Arguably, ISO 10723 should be done any time there’s a major change in thermal conductivity property of detector

Page 56: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Considering all that

• Can the frequency of ISO 10723 be reduced?

• What would be the requirement to do that?

Page 57: By Anwar Sutan - i-Vigilant...By Anwar Sutan Agenda • Objectives • Regulation Requirements • Issues in analyzer system • ISO 10723 Intention and Practices • Case Studies

Thank [email protected]

i-Vigilant

@i_Vigilant

i-Vigilant