![Page 1: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/1.jpg)
Dr Barry Stemshorn
1st OIE PVS Pathway Orientation Training
Workshop for South Asia
Paro Bhutan, February 12-15, 2019
Managing an OIE
PVS Evaluation
Part 2: from site selection
to report follow up
![Page 2: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/2.jpg)
CONTENTS
1. ✓Pre-mission activities
2. ✓Exercise on site selection
3. The mission
4. After the mission
![Page 3: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/3.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 3
3. THE MISSION
![Page 4: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/4.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 4
▪ Size
• From one government veterinarian to thousands of
government veterinarians and VPP
▪ Structure
• Centralised or decentralised?
• Split between Veterinary Authority, Public Health, other departments
▪ Stage of development
• Little or nothing
• Well developed in some/many critical competencies
• Large private sector/extensive delegation
Countries Vary
![Page 5: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/5.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 5
Site Visits - ideal conditions
![Page 6: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/6.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 6
Split team up for greater coverage? Weigh pros and cons
Aim to be as representative as possible – but there arelimits
Heed your country’s advice on travel safety/security
Resources for translation and transport
Be flexible: welcome unplanned interviews and discussions
Get off the main road
Interviews can be lengthy - listen and engage
Look for consistency and inconsistencies; explore gaps
Gather and record evidence as you go
Site Visits
![Page 7: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/7.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 7
Transport: nearly 900,000 Km
![Page 8: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/8.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 8
…of hard use
![Page 9: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/9.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 9
The need to see it:…vehicle disinfection?
![Page 10: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/10.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 10
A laboratory never used
![Page 11: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/11.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 11
…and an under-used new one
![Page 12: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/12.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 12
Pre-mission data/documents
In-country documents –
policies, regulations, plans,
reports, maps, etc.
Meetings & interviews with:
Veterinary Services
Other government agencies
Private sector
Observations and field visits
(including photos)
Record and reference
Evidence
![Page 13: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/13.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 13
Compile initial findings
Compare notes, cite evidence, clarify inconsistencies
Seek missing information
Assign levels and draft findings & recommendations
Disagreements – investigate further in final days
Leave country with agreement across all CCs
Closing Meeting
Overview of preliminary findings - gauge responses
Findings & Recommendations
![Page 14: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/14.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 14
4. THE REPORT
![Page 15: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/15.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 15
Assign workload to team
(pre-, during and post-mission)
Follow the OIE report template/manuals
Well written in plain (OIE official) language
Clear findings & recommendations and
relevant information
Useful for national decision makers,
donors and experts undertaking
subsequent PVS activities
Report
![Page 16: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/16.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 16
PART I: Executive Summary
➢ The most important section
➢ Brief, succinct, to the point!
Content:
A summary of the PVS Evaluation results
Table with Level of Advancement for each CC
Key findings for each Fundamental Component
Key recommendations for each Fundamental
Component – including Targeted Support
![Page 17: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/17.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 17
I OIE PVS Tool
II Context
- VS data & organisation
- Animal health and disease control
- Data tables
III Organisation of the evaluation
PART II. Conduct of the Evaluation
![Page 18: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/18.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 18
I-1 Professional and
technical staffing of
the Veterinary
Services (VS)
The appropriate staffing
of the VS to allow for
veterinary and technical
functions to be
undertaken efficiently
and effectively.
A. Veterinary and other
professionals (university
qualification)
Levels of advancement
1. The majority of veterinary and other professional
positions are not occupied by appropriately qualified
personnel.
2. The majority of veterinary and other professional
positions are occupied by appropriately qualified
personnel at central and state/provincial levels.
3. The majority of veterinary and other professional
positions are occupied by appropriately qualified
personnel at local (field) level.
4. There is a systematic approach to defining job
descriptions and formal appointment procedures for
veterinarians and other professionals.
5. There are effective management procedures for
performance assessment of veterinarians and other
professionals.
PART III. Critical Competencies (CCs)
CC table with Level of Advancement (LoA) shaded in grey
![Page 19: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/19.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 19
Critical Competencies (CCs)
Findings
Strengths
Weaknesses
Recommendations
Evidence
With cross references
to appendix
![Page 20: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/20.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 20
(example)A. Laboratory quality management systems (QMS)
The quality and reliability of veterinary laboratory testing servicing
the public sector VS as assessed by the use of formal QMS including,
but not limited to, attainment of ISO 17025 accreditation and
participation in proficiency testing programmes.
Levels of advancement
1. No laboratories servicing the public sector VS are using formal QMS.
2. One or more laboratories servicing the public sector VS, including the
major national animal health reference laboratory, are using formal
QMS.
3. Most major laboratories servicing the public sector VS are using
formal QMS. There is occasional use of multi-laboratory proficiency
testing programmes.
4. All the laboratories servicing the public sector VS are using formal
QMS, with regular use of multi-laboratory proficiency testing
programmes.
5. All the laboratories servicing the public sector VS are using formal
QMS systems, which are regularly assessed via national, regional or
international proficiency testing programmes.
Findings:
Narrative
Narrative
Strengths:
•Bullet point 1
•Bullet point 2
Weaknesses:
•Bullet point 1
•Bullet point 2
Recommendations
•Bullet point 1
•Bullet point 2
Evidence (as listed in Appendix 6):
![Page 21: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/21.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 21
1. References to the Codes
2. Glossary
3. Country Information
4. List of places visited, persons met
5. Air travel details
6. Reference documents/evidence
7. Organisation of the evaluation
IV. Appendices
![Page 22: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/22.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 22
After The Mission
![Page 23: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/23.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 23
Finalise draft report within 1 month
team drafts; leader is ultimately responsible
Peer review by OIE
Final draft back to country for review
Finalise report
NOTE!
The OIE Delegate can keep reports confidential
After The Mission
![Page 24: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/24.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 24
Quality control to ensure:
Compliance with PVS methodology
All Critical Competencies are adequately addressed
Level of advancement consistent with evidence and findings
Uniformity of reports – format, structure, language, etc.
Concise and effective Executive Summary
Peer reviewers:
Experienced PVS Experts, usually Team Leaders (TL)
Liaise with TL and OIE HQ to finalise preliminary report
Draft cover letter to OIE Delegate with report summary
Peer Review
![Page 25: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/25.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 25
OIE HQ checks/adjusts format.
OIE DG sends report to the OIE Delegate inviting
comments.
Changes to levels of advancement are uncommon.
Require solid evidence and agreement of the team.
OIE encourages public release (via OIE web site), or
sharing with partners & donors. Decision lies with the OIE
Delegate.
PVS experts are bound to strict confidentiality.
Next Steps
![Page 26: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/26.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 26
Gap Analysis
Veterinary legislation
Laboratory sustainability
Veterinary education (Day 1 competencies)
Veterinarians and VPP
Twinning arrangements
Laboratories, education (DVM and VPP), VSB
JEE and National Bridging Workshops with WHO
Strategic Planning
PVS targeted support
![Page 27: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/27.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 27
➢ Identify the national priorities for 4 pillars:
Livestock Development
Veterinary Public Health
Animal Health
Management of Veterinary and Regulatory Services
➢ Identify a reasonable level of advancement for each
CC in 5 years
➢Develop feasible strategies and activities to meet
the targeted level of advancement
➢ Identify required investments and costs over 5 years
PVS Gap Analysis
![Page 28: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/28.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 28
Process and inputs:
Work usually done at HQ of VA - no field activities
OIE Team provides facilitation
Decisions on national priorities, targeted levels of advancement,
strategies and actions are made by the country
Essential national inputs:
Comprehensive data on costs, scope of operations, etc.
Full participation of senior officers
…PVS Gap Analysis
![Page 29: Managing an OIE PVS Evaluation Part 2: from site selection ... · 5/6/2020 · Dr Barry Stemshorn 1st OIE PVS Pathway Orientation Training Workshop for South Asia Paro Bhutan, February](https://reader033.vdocuments.us/reader033/viewer/2022042921/5f67ebb37d4f3813a37d51bb/html5/thumbnails/29.jpg)
World Organisation for Animal Health · Protecting animals, Preserving our future | 29
12, rue de Prony, 75017 Paris, France
[email protected] - [email protected]
Thank you for your attention!