WFP EVALUATION

WFP Office of Evaluation

Annual Evaluation Report 2020

May 2021Andrea Cook

Director of Evaluation

❖ PART 1: Overview of centralized, decentralized evaluations

and impact evaluations 2020–2021

❖ PART 2: Progress report on WFP’s

evaluation function & performance

❖ PART 3: Outlook for WFP’s evaluation function

PART 1: Overview of centralized, decentralized and impact evaluations

4

Policy evaluations

Title 2020 2021

• WFP gender policy annual session

• South-South and triangular cooperation

policyongoing annual session

• WFP’s role in peacebuilding in transition

settingsnew start ongoing

5

Strategic evaluations

Title 2020 2021

• Funding WFP’s work annual session

• School feeding’s contribution to the

Sustainable Development Goalsongoing annual session

• WFP’s use of technology in constrained

environmentsongoing

• Nutrition and HIV/AIDS new start

Cameroon

The Gambia

WFP presence

Country Strategic Plan Evaluations ongoing in 2021

Country Strategic Plan Evaluations completed in 2020

Bangladesh

Indonesia

Timor-Leste

China

Honduras

Zimbabwe

Laos

El Salvador

Country Strategic Plan Evaluations new starts in 2021

Afghanistan

Algeria

Bolivia

Mozambique

Central African Republic

Chad

Ecuador

Haiti Jordan

Tajikistan

Mauritania

Nigeria

Pakistan

Peru

Sri Lanka

Sudan

Kyrgyzstan

United Republic

of Tanzania

Democratic Republic of the Congo

Lebanon

State of Palestine

India

South Sudan

Country strategic plan evaluations

7

Evaluations of emergency responses

Title 2020 2021

Corporate

emergency

response

• WFP’s response to the COVID-19 pandemic new start

Inter-agency

humanitarian

• Inter-agency humanitarian evaluation of the response

to Cyclone Idai in Mozambiquecompleted

• Inter-agency humanitarian evaluation of gender

equality and empowerment of women and girlscompleted

• Inter-agency humanitarian evaluation of the response

to the humanitarian crisis in Yemennew start

• Inter-agency humanitarian evaluation of the COVID-19

response new start

8

Evaluation syntheses

Title 2020 2021

• Synthesis of evidence and lessons from WFP’s

policy evaluationsannual session

• Synthesis of evidence and lessons on country

capacity strengthening from WFP decentralized

evaluations

ongoing annual session

• New topic to be determined new start

9

Impact evaluation windows

Climate change and

resilience

Niger

Mali

Democratic Republic of the Congo

South Sudan

El Salvador

Kenya

Syrian Arab Republic

Rwanda

Cash-based transfer

modality and gender

equitable and women’s

empowerment outcomes

Up to two additional IE

Up to two additional IE

School-based programming Up to six additional IE

10

Joint evaluations and activities

Title 2020 2021

Evaluations • Rome-based United Nations agency collaboration ongoingsecond

session

Activities

• Global Action Plan for Healthy Lives and Well-beingcompleted

• COVID-19 Global Evaluation Coalition ongoing ongoing

• United Nations Evaluation Group’s COVID-19 Multi-

Partner Trust Fund (MPTF) Advisory Group ongoing ongoing

• Inter-agency exercise on food security and nutrition completed

11

Completed decentralized evaluations by region/headquarters and year of completion, 2016–2020

2

1 1

3

2

3

1 1

2

1

6

4

7

4 4

1

2

1

4

3

4 44

5

2

4 4

3

2

HQ RBB RBC RBD RBJ RBN RBP

2016 2017 2018 2019 2020

RBN 16

RBJ 12

RBD 17

RBC 8

RBB 18

RBP 8

HQ 6

TOTAL

12

Numbers of country offices with completed or ongoing decentralized evaluations by region (2016-2020)

1516

19

12

9

12

10

8

13

9

67

1

2

3

1

3

RBNRBJRBDRBCRBB RBP Total number of country offices

Country offices that have

completed at least one

decentralized evaluation since

2016

Country offices that have

not completed a

decentralized evaluation

but have at least one under

way or being prepared

Completed

decentralized

evaluations by

programme area

(2016–2020)

unconditional resource

transfers to support

access to food

asset creation

and livelihood

support

climate adaptation

and risk

management

school

feeding

nutrition

smallholder

agricultural market

support

capacity

strengthening

emergency

preparedness

other

2

1

2

1

1

4

1

1

3

1

3

6

1

1

2

2

11

2

7

13

1

5

8

2

3

10

3

6

11

3

4

3

2

4

6

3

3

14

1

3

201820172016 2019 2020

Decentralized evaluations can cover more than one programmatic area

PART 2: Progress report on WFP’s evaluation function in 2020

15

Major developments (i)

Scaling up CSP

evaluations

CSP

Global

COVID-19

pandemic

Mid-term review of

regional evaluation

strategies

1 0 0 11 001 111 011

1 1 0 11 100 111 010

1 0 0 11 010 111 011

Resourcing

UNEG/OECD-DAC

external peer review

of evaluation

Evaluation

function review

Strategy

development

REMOTE EVALUATIONS

INTERACTIVE WEBINARS

VIRTUAL MEETINGS

VIRTUAL WORKSHOPS

USE OF NATIONAL EVALUATORS

VIRTUAL EVENTS

REMOTE DATA COLLECTION

16

Major developments (ii)Adaptation to COVID-19 pandemic

Evaluation coverage norms

17

Centralized evaluations

Country specific evaluations:

country portfolios, corporate

emergency response, impact,

operation

Global evaluations: policy,

strategic, syntheses

Country specific and global

evaluations

Post-hoc quality assessment of evaluation reports completed, 2016–2020

18

Evaluation Quality

3

21 1

1

1

1

2

3

4

216

2

6

2

2

6

198

3

2

3

1

2

1 2 2

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

2016 2017 2018 2019 2020 2016 2017 2018 2019 2020

CENTRALIZED EVALUATIONS DECENTRALIZED EVALUATIONS

Highly satisfactory

Satisfactory

Partly satisfactory

Unsatisfactory

2020

Exceeds requirements

Meets requirements

Approaches requirements

Partially meets requirements

2016-2019

Evaluation uptake

Percentage of draft country

strategic plans reviewed

and commented on by the WFP

Office of Evaluation

Commented

Not commented

100%

6

6draft

I/CSP

Implementation

status of evaluation

recommendations

due in 2020

Implemented

Not implemented

56%

44%

11088 198

recommendations

technical notes

EvalMAPPER tool

summary of evidence

evidence generation exercises

thematic learning papers

evaluation Twitter channel

user engagement

R2 tracking system

accessible products

promote use of

evidence

COVID-19 Global

Evaluation Coalition

virtual events and

workshops

20

Strengthening evaluation partnerships

Joint and Inter-Agency Humanitarian Evaluations

2020

2019

2018

2017

2016

Decentralized2 JE

Decentralized4 JE

Decentralized3 JE

Centralized1 IAHE

Centralized1 JE

Centralized1 IAHE

Centralized2 IAHE

Decentralized5 JE

Inter-Agency Humanitarian Evaluation

Centralized Joint Evaluation

Decentralized Joint Evaluation

Government of BeninGovernment of Malawi

Government of Mozambique Government of Namibia

21

22

Strengthening national evaluation capacity

23

Expenditure on evaluation as a percentage of WFP total contribution income (2016–2020)

0.15%

0.18%0.19%

0.24%

0.28%

0

5

10

15

20

25

2016 2017 2018 2019 2020

Millio

ns

DE conduct cost

DE management cost

Total expenditure RBx

Centralized expenditure

24

Composition of evaluation teams: gender ratio and geographical diversity, 2020

Developed

country

40 38

53

Centralized

evaluations

Decentralized

evaluations

Developed

country

Developing

country

GEOGRAPHICAL DIVERSITY

Developing

country

18

32 41

2650

Centralized

evaluations

Decentralized

evaluations

GENDER RATIO

Women Women

Men

Men

Developed

country

25

Composition of the Office of Evaluation and evaluation teams at the regional bureau level: gender ratio and geographical diversity

46

9

5

10

OEV Regional Bureaux

Developed

country

Developed

country

Developing

country

GEOGRAPHICAL DIVERSITY

Developing

country

38

16

13

3

OEV Regional Bureaux

GENDER RATIO

Women

Women

Men

Men

PART 3: Outlook for WFP’s evaluation function

27

2020 Peer Review

• WFP has established a strong and mature centralized evaluation function.

• The decentralized evaluation system is less mature, but significant progress has been made

OVERALL ASSESSMENT

• WFP’s central evaluation function has a high degree of structural and functional independence –finding in line with previous assessmentsINDEPENDENCE

• Evaluation function and its products have high degree of credibility

• OEV has established very robust principles, guidance and practices for both centralized and decentralized evaluations

CREDIBILITY

• Evaluation increasingly is seen as enhancing learning and good practice, as well as accountability

• Need continued focus to drive transition from: “Accountability for results” to “accountability for learning for results”, striking an optimal balance between accountability and learning

UTILITY

Key priorities for the evaluation function

1) Independent, credible and

useful centralized and decentralized

evaluations

2) Appropriate centralized and decentralized

evaluation coverage

3) Adequate evaluation

management capacity across

WFP

4) Active evaluation

partnerships in international

arena