wfp’s new evaluation function...wfp’s evaluation function framing documents policy charter (ed...
TRANSCRIPT
![Page 1: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/1.jpg)
WFP’s new Evaluation Function
Update on implementation
WFP Office of Evaluation
Annual Consultation on Evaluation27th May 2016 Helen Wedgwood
Director of Evaluation
![Page 2: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/2.jpg)
WFP’s Evaluation Function framing documents
Policy
Charter (ED Circular)
Corporate Strategy
Policy sets vision & strategic direction for WFP’s new evaluation function (Centralized and Decentralized)
Strategy describes all the elements/workstreams
necessary for phased implementation
Charter sets new mandate, governance,
authorities & institutional
arrangements
![Page 3: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/3.jpg)
Policy Theory of Change: Vision
WFP’s contribution to ending global hunger
is strengthened by evaluative thinking,
behaviour and systems embedded in its
culture of accountability and learning
![Page 4: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/4.jpg)
1) Independent, credible and useful
centralized and decentralized evaluations
2) Appropriate centralized and decentralized
evaluation coverage
3) Adequate evaluation management capacity
across WFP
4) Active evaluation partnerships
in international arena
Policy Theory of Change: Outcomes
![Page 5: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/5.jpg)
WFP EVALUATION CHARTER
![Page 6: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/6.jpg)
Institutional arrangements
EXISTING (slightly modified; no change) NEW
• EB Annual Consultation on Evaluation• Management Response & Follow Up• Strategic Programme Review Process• Staff Performance Management &
Directors’ Assurance• Post-hoc Quality Assessment• Knowledge Management System• Executive Management Group• External Peer Review
1. Evaluation Function Steering Group
2. Regional Evaluation Committee
3. Sustainable Financing Mechanism
4. DE Committee (temporary)
5. Hotline
6. Evaluation Community of Practice
![Page 7: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/7.jpg)
WFP’s EVALUATION STRATEGY 2016-2021
![Page 8: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/8.jpg)
O1: Independent, credible & useful
centralized & decentralized
evaluations
O2: Appropriate centralized & decentralized
evaluation coverage
O3: Adequate evaluation
management capacity across
WFP
O4: Active evaluation
partnerships in international arena
Quality assurance
Post-hoc quality assessment
Impartiality provisions
Use of evaluations
B: Reporting
Institutional arrangements
Funding
Planning
WFP capacity development
Staffing
National & regional capacity
development
Partnerships
Quality supportEvaluator expertise
A: Normative Framework
Coverage norms
C: Communication & Knowledge Management
![Page 9: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/9.jpg)
O1: Independent, credible & useful
centralized & decentralized
evaluations
O2: Appropriate centralized & decentralized
evaluation coverage
O3: Adequate evaluation
management capacity across
WFP
O4: Active evaluation
partnerships in international arena
Quality assurance
Post-hoc quality assessment
Impartiality provisions
Use of evaluations
B: Reporting
Institutional arrangements
Funding
Planning
WFP capacity development
Staffing
National & regional capacity
development
Partnerships
Quality supportEvaluator expertise
A: Normative Framework
Coverage norms
C: Communication & Knowledge Management
![Page 10: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/10.jpg)
Financing model
Project Budget Line DSC and in future under
FFR ‘implementation costs’
SRAC allocations(multilateral)
Contingency Evaluation FundPSA
- Conduct & management (staff time) of DEs
- Support COs facing genuine resource constraints
- OEV’s services to support the DE function (e.g. Capacity development for DE, outsources quality support mechanism)
- Conduct & management (staff time) of CEs (OEV Annual Workplan)
- Delivering on OEV augmented responsibility e.g. (standards, oversight, reporting)
- 6 Regional Evaluation Officers
![Page 11: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/11.jpg)
O1: Independent, credible & useful
centralized & decentralized
evaluations
O2: Appropriate centralized & decentralized
evaluation coverage
O3: Adequate evaluation
management capacity across
WFP
O4: Active evaluation
partnerships in international arena
Quality assurance
Post-hoc quality assessment
Impartiality provisions
Use of evaluations
B: Reporting
Institutional arrangements
Funding
Planning
WFP capacity development
Staffing
National & regional capacity
development
Partnerships
Quality supportEvaluator expertise
A: Normative Framework
Coverage norms
C: Communication & Knowledge Management
![Page 12: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/12.jpg)
O1: Independent, credible & useful
centralized & decentralized
evaluations
O2: Appropriate centralized & decentralized
evaluation coverage
O3: Adequate evaluation
management capacity across
WFP
O4: Active evaluation
partnerships in international arena
Quality assurance
Post-hoc quality assessment
Impartiality provisions
Use of evaluations
B: Reporting
Institutional arrangements
Funding
Planning
WFP capacity development
Staffing
National & regional capacity
development
Partnerships
Quality supportEvaluator expertise
A: Normative Framework
Coverage norms
C: Communication & Knowledge Management
![Page 13: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/13.jpg)
Provisions for Impartiality & Independence for Decentralized
Evaluations
SRAC allocations(multilateral)
Contingency Evaluation Fund
PSA
• DEQAS• Help-desk • Publicly available• Independent consultants• Assessment of potential
conflicts of interest• Evaluation manager• Evaluation Committee• Evaluation reference
group
At evaluation level
• Roles and accountabilities integrated into PACEs and Internal control assurance statements for Directors
• OEV hotline
• Post-hoc QA
• Code of Conduct for Evaluators
At system level
![Page 14: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/14.jpg)
O1: Independent, credible & useful
centralized & decentralized
evaluations
O2: Appropriate centralized & decentralized
evaluation coverage
O3: Adequate evaluation
management capacity across
WFP
O4: Active evaluation
partnerships in international arena
Quality assurance
Post-hoc quality assessment
Impartiality provisions
Use of evaluations
B: Reporting
Institutional arrangements
Funding
Planning
WFP capacity development
Staffing
National & regional capacity
development
Partnerships
Quality supportEvaluator expertise
A: Normative Framework
Coverage norms
C: Communication & Knowledge Management
![Page 15: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/15.jpg)
Projected progressive application of coverage norms
(Estimated number of evaluations)
Project Budget (DE) DSC and in future under
FFR ‘implementation costs’
SRAC allocations(multilateral)
Contingency Evaluation Fund
PSA
![Page 16: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/16.jpg)
2016 DE plans & simulations for 2018 & 2021
![Page 17: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/17.jpg)
O1: Independent, credible & useful
centralized & decentralized
evaluations
O2: Appropriate centralized & decentralized
evaluation coverage
O3: Adequate evaluation
management capacity across
WFP
O4: Active evaluation
partnerships in international arena
Quality assurance
Post-hoc quality assessment
Impartiality provisions
Use of evaluations
B: Reporting
Institutional arrangements
Funding
Planning
WFP capacity development
Staffing
National & regional capacity
development
Partnerships
Quality supportEvaluator expertise
A: Normative Framework
Coverage norms
C: Communication & Knowledge Management
![Page 18: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/18.jpg)
Matching KPIs to the Theory of Change
O1: Independent, credible & useful
centralized & decentralized
evaluations
O2: Appropriate centralized & decentralized
evaluation coverage
O3: Adequate evaluation
management capacity across
WFP
O4: Active evaluation
partnerships in international arena
1. Embedding the evaluation function in WFP
2. Resourcing of the evaluation function
3. Evaluation coverage
4. Quality of
evaluations
5. Learning & use
6. Effectiveness &
efficiency of evaluation
partnerships
Purpose: Evaluation results are consistently and comprehensively integrated into WFP’s policies, strategies and programmes.
![Page 19: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/19.jpg)
Matching KPIs to audience
Evaluation Function
Management
Executive
Board
Evaluation Function Steering
Group
• Budget & Programming
• Performance Mgt & Monitoring
• Office of Evaluation
• Regional Evaluation Officers
• Regional Bureaux
• Country Offices
![Page 20: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/20.jpg)
O1: Independent, credible & useful
centralized & decentralized
evaluations
O2: Appropriate centralized & decentralized
evaluation coverage
O3: Adequate evaluation
management capacity across
WFP
O4: Active evaluation
partnerships in international arena
Quality assurance
Post-hoc quality assessment
Impartiality provisions
Use of evaluations
B: Reporting
Institutional arrangements
Funding
Planning
WFP capacity development
Staffing
National & regional capacity
development
Partnerships
Quality supportEvaluator expertise
A: Normative Framework
Coverage norms
C: Communication & Knowledge Management
![Page 21: WFP’s new Evaluation Function...WFP’s Evaluation Function framing documents Policy Charter (ED Circular) Corporate Strategy Policy sets vision & strategic direction for WFP’s](https://reader034.vdocuments.us/reader034/viewer/2022043014/5fb03aa38b6aec1a1c70c126/html5/thumbnails/21.jpg)
Next steps for Evaluation Function Reporting
Annual Consultation on Evaluation
Establishing MIS & testing (Part II)
2016
Initiation of new Reporting System
Consultation: Evaluation Function Steering Group, RMP, functional
specialists in RBs & some COs
Refining & testing (Part I)
- Alignment with final draft CRF & FFR
- Consultation with EB through OEV Work Plan- Finalize content & Phasing
May
Mid-June – Mid-July August
September Oct-Dec
Jan 2017
Top level
KPIs
Consultation with IT & Communications on MIS