verification and validation - washington state …...2018/10/18  · don’t confuse regulation with...

11
1 ©Copyright AIB International May not be reproduced without written permission. ©Copyright AIB International May not be reproduced without written permission. ©Copyright AIB International May not be reproduced without written permission. Understanding Verification & Validation November 2018 Verification and Validation True or False? Production of safe, high quality food happens by luck and chance. Production of safe, high quality food takes skill, knowledge, thoughtful planning, and reliable execution. False True

Upload: others

Post on 07-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Verification and Validation - Washington State …...2018/10/18  · Don’t confuse regulation with scientific validation Verification of a bad plan will end badly “We’ve always

1

©Copyright AIB InternationalMay not be reproduced without

written permission.

©Copyright AIB InternationalMay not be reproduced without written permission.

©Copyright AIB InternationalMay not be reproduced without written permission.

Understanding Verification & Validation

November 2018

Verification and Validation

True or False?

Production of safe, high quality food happens by luck        and chance.       

Production of safe, high quality food takes skill, knowledge, thoughtful planning, and reliable execution. 

False

True

Page 2: Verification and Validation - Washington State …...2018/10/18  · Don’t confuse regulation with scientific validation Verification of a bad plan will end badly “We’ve always

2

©Copyright AIB InternationalMay not be reproduced without

written permission.

Verification and Validation

Validation  

What evidence do we have that our existing plan/policies/ procedures will result in safe, high quality food?

How do we know we have the correct:

– Cleaning procedures

– Oven temperatures

– Preventive maintenance schedule

Verification and Validation

Verification  

Are doing what we said we would do? Are we following our plan/ policies/ procedures?

– GMPs

– Maintenance

– Sanitation

– Process controls

– QA checks

– HACCP / preventive controls

Page 3: Verification and Validation - Washington State …...2018/10/18  · Don’t confuse regulation with scientific validation Verification of a bad plan will end badly “We’ve always

3

©Copyright AIB InternationalMay not be reproduced without

written permission.

Verification and Validation

Validation – Evidence of Effectiveness

What does the science tell us?

• Temperature impact on microorganisms

• Stock rotation frequency based on insect lifecycles

• Which cleaning agents work best on specific soil types

• Which orientation to use with our metal detector test pieces

Verification and Validation

Verification – Did We Follow Our Plan?

• Are employees complying with GMPs?

• Were sanitation procedures followed?

• Did we conduct maintenance at the defined frequency?

• Did we check our metal detector with the defined test pieces?

Page 4: Verification and Validation - Washington State …...2018/10/18  · Don’t confuse regulation with scientific validation Verification of a bad plan will end badly “We’ve always

4

©Copyright AIB InternationalMay not be reproduced without

written permission.

Verification and Validation

Self‐Inspections Internal Audits

Feet Seat

Verification and Validation

Self‐Inspections

• Line is about to start and it’s not clean

• Doors to the exterior are propped open

Internal Audits

• Maintenance schedule does not include packaging machines

Page 5: Verification and Validation - Washington State …...2018/10/18  · Don’t confuse regulation with scientific validation Verification of a bad plan will end badly “We’ve always

5

©Copyright AIB InternationalMay not be reproduced without

written permission.

Verification and Validation

Self‐Inspections

• Refrigerated goods stored on ambient dock for extended time

• Wrong color scoop used for allergens

Internal Audits

• Records show that an untrained person was cleaning the line

Verification and Validation

Handwashing

Verification Validation

Observation  Swab

Page 6: Verification and Validation - Washington State …...2018/10/18  · Don’t confuse regulation with scientific validation Verification of a bad plan will end badly “We’ve always

6

©Copyright AIB InternationalMay not be reproduced without

written permission.

Verification and Validation

Kill Step (Cooking)

Verification Validation

Temperature Checks Scientific Literature

Verification and Validation

Refrigeration

Verification Validation

Temperature Checks Scientific Literature at Warmest Location

Page 7: Verification and Validation - Washington State …...2018/10/18  · Don’t confuse regulation with scientific validation Verification of a bad plan will end badly “We’ve always

7

©Copyright AIB InternationalMay not be reproduced without

written permission.

Verification and Validation

Sanitizer Concentration

Verification Validation

PPM Tests Scientific Literature

Verification and Validation

Placement of Rodent Traps

Verification Validation

Correct Rodent Biology Placement Research

Page 8: Verification and Validation - Washington State …...2018/10/18  · Don’t confuse regulation with scientific validation Verification of a bad plan will end badly “We’ve always

8

©Copyright AIB InternationalMay not be reproduced without

written permission.

Verification and Validation

Stock Rotation of Insect‐Susceptible Materials

Verification Validation

Checking Age Insect Biology Research of Materials

Verification and Validation

Ozonation of Bottled Water

Verification Validation

Ozone Test Ozone Science

Page 9: Verification and Validation - Washington State …...2018/10/18  · Don’t confuse regulation with scientific validation Verification of a bad plan will end badly “We’ve always

9

©Copyright AIB InternationalMay not be reproduced without

written permission.

Verification and Validation

Due Diligence

Reasonable Steps Taken to Ensure Safe Food

Records of verification and validation = due diligence

Verification and Validation

Include Verification and Validation Concepts

in Training

Validation –WHY it’s important to do it this way!

Verification –When you create a record, you are providing evidence that we followed our procedures –or took action when things went astray. 

Page 10: Verification and Validation - Washington State …...2018/10/18  · Don’t confuse regulation with scientific validation Verification of a bad plan will end badly “We’ve always

10

©Copyright AIB InternationalMay not be reproduced without

written permission.

Verification and Validation

Watch Outs

Don’t confuse regulation with scientific validation

Verification of a bad plan will end badly

“We’ve always done it this way” is not validation

Verification and Validation

Watch out ‐ Absence of complaints is not enough

Analogy:

On average, a drunk driver will drive under the influence 80 times before his first arrest or accident.

Does this mean that someone who has driven under the influence 79 times should conclude that drunk driving is safe?

Page 11: Verification and Validation - Washington State …...2018/10/18  · Don’t confuse regulation with scientific validation Verification of a bad plan will end badly “We’ve always

11

©Copyright AIB InternationalMay not be reproduced without

written permission.

Verification and Validation

Verification

Proof that you are following your plan

Validation

Proof that you have created a well‐thought out, science‐based plan

Questions