theory of change - abdul latif jameel poverty action lab
TRANSCRIPT
![Page 1: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/1.jpg)
Theory of Change
Aparna Krishnan
JPAL South Asia at IFMR
3 July, 2017
![Page 2: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/2.jpg)
Course Overview
1. What is Evaluation?
2. Theory of Change
3. Outcome, Impact, & Indicators
4. Why Randomize?
5. How to Randomize?
6. Sampling and Sample Size
7. Threats and Analysis
8. Research to Policy
9. Project from Start to Finish
J-PAL| THEORY OF CHANGE 2
![Page 3: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/3.jpg)
Session Overview
I. Context: Program cycle
II. Building a Theory of Change (in 6 steps)
III. Why is Theory of Change important?
J-PAL| THEORY OF CHANGE 3
![Page 4: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/4.jpg)
CONTEXT: PROGRAM CYCLE
![Page 5: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/5.jpg)
Lifecycle of a Program
CONCEPTUALIZATI
ON & DESIGN PROGRAM
IMPLEMENTATION
PROGRAM
ASSESSMENT FOR
DECISIONS
PROGRAM MONITORING AND EVALUATION
J-PAL| THEORY OF CHANGE 5
![Page 6: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/6.jpg)
Components/Stages of Program Evaluation
• Needs Assessment
• Program Theory
Assessment
• Process Evaluation
• Impact Evaluation
• Cost Effectiveness
• What is the problem?
• How, in theory, does the
program fix the problem?
• Does the program work as
planned?
• Were its goals achieved?
The magnitude?
• Given magnitude and cost, how
does it compare to alternatives?
Imp
lem
en
tatio
n
Co
nc
ep
tua
lizi
ng
An
d D
esi
gn
ing
Pro
gra
m
Ass
ess
me
nt
Build a Theory of Change
6
![Page 7: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/7.jpg)
• Definition
– Theory of change is an on-going process of reflection
to explore change and how it happens – and what
that means in a particular context, sector, and/or
group of people.
• ToC thinking
– Structured way of thinking about change and impact
to be achieved
– Integrated approach to program design,
implementation, M+E, and communication
Theory of Change (ToC)
J-PAL| THEORY OF CHANGE 7
![Page 8: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/8.jpg)
Causal Hypothesis
Q: How do I expect results to be achieved?
A: If [inputs] and [activities] produce [outputs] this should
lead to [outcomes] which will ultimately contribute to
[goal].
• ToC maps the expected causal pathway between Inputs
+ Activities and the Desired outcomes, assumptions and
risks in implementation
• Is usually represented in a schematic diagram and a
logical framework table
J-PAL| THEORY OF CHANGE 8
![Page 9: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/9.jpg)
Inputs/
Program Activities
Outputs Intermediate
outcomes Goal
Theory of Change Components
What we do
as a part of
the program -
deliver, teach,
offer loans,
etc.
What are the
resources used
–funds, staff,
equipment,
curriculum, all
materials
Tangible
products or
services
produced as
a result of
the activities
Short-term
behavioral
changes that
result from the
outputs -
preventive
health habits,
usage of
tablets
Long-term
changes
that result
from
outcomes –
the result of
the program
J-PAL| THEORY OF CHANGE 9
![Page 10: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/10.jpg)
A close cousin: the Logical Framework
J-PAL| THEORY OF CHANGE 10
![Page 11: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/11.jpg)
If a school implements a free textbook
program with the aim of improving learning
outcomes, the number of textbooks
successfully delivered is an…
A. Input
B. Output
C. Intermediate
Outcome
D. Goal
A. B. C. D. E. F. G.
0% 0% 0% 0%0%0%0%
11 J-PAL | THEORY OF CHANGE
![Page 12: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/12.jpg)
BUILDING A THEORY OF
CHANGE (IN 6 STEPS)
![Page 13: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/13.jpg)
1. Situation analysis – Specifying the context
2. Clarify the program goal
3. Design the program /product
4. Map the causal pathway
5. Explicate assumptions
6. Design SMART indicators
6 Steps to Building a ToC
J-PAL| THEORY OF CHANGE 13
![Page 14: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/14.jpg)
EXAMPLE:
IMMUNIZATION INCENTIVES PROJECT,
RAJASTHAN
14
![Page 15: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/15.jpg)
What do you think is the most cost-effective
way to increase full immunization rates?
A. Community mobilization
campaign
B. Improve healthcare
worker attendance
C. Develop new vaccines
such as pneumococcal
D. Hold special
‘immunization camps’
E. Incentivize parents to
immunize their children
A. B. C. D. E. F. G.
0% 0% 0% 0%0%0%0%
15 J-PAL | THEORY OF CHANGE
![Page 16: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/16.jpg)
1. Situation analysis – Specifying the context
2. Clarify the program goal
3. Design the program/product
4. Map the causal pathway
5. Explicate assumptions
6. Design SMART indicators
6 Steps to Building a ToC
J-PAL| THEORY OF CHANGE 16
![Page 17: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/17.jpg)
Step 1: Situation/Context Analysis
• What it is:
– Identifying target population (beneficiaries)
– Needs, opportunities, barriers to progress
– Map relevant stakeholders
– Analyze broader political and economic context
• Purpose:
– Begin to design the right product, identify markers for
success
Map opportunities, risks, broader context
J-PAL| THEORY OF CHANGE 17
![Page 18: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/18.jpg)
Step 1: Situation/Context Analysis
The Need
• Every year, between 2 and 3 million people die from
vaccine-preventable diseases
• Only 54% of 1-2 year olds in India receive the basic
package of immunizations
– BCG, DPT, Polio, and Measles vaccines
– At least 5 visits
J-PAL| THEORY OF CHANGE 18
![Page 19: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/19.jpg)
Step 1: Situation/Context Analysis
What is the Problem ?
• In India, immunizations are offered for free… but the
immunization rate remains low
• In rural Rajasthan, this rate falls to 22%
J-PAL| THEORY OF CHANGE 19
![Page 20: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/20.jpg)
Step 1: Situation/Context Analysis
Underlying Issues
• Supply side constraints:
– Average household is within 2 kilometers of the nearest clinic
– High absenteeism at government health facilities – 45% of
Auxiliary Nurse Midwives are absent on any given workday
• Demand side constraints:
– Cultural resistance, distrust in public health institutions
– People don’t value immunizations: short-term cost for long-
term (and invisible) benefits
– Limited income: parents can’t afford to take a day off
J-PAL| THEORY OF CHANGE 20
![Page 21: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/21.jpg)
Step 1: Situation/Context Analysis
Situation/Context Analysis: High health worker absenteeism, low value of
immunization, limited income and time
J-PAL| THEORY OF CHANGE 21
![Page 22: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/22.jpg)
Supply-side Solutions
• Strengthening of the existing government program
– Stronger mechanisms to address staff absenteeism in clinics
– Tracking of unimmunized children and providing immunization
– More regular camps?
Demand-side Solutions
– Information campaigns
– Address lingering doubts regarding problems arising out of
immunizations
– What about giving people incentives? Is this feasible?
Weigh Alternative Solutions
J-PAL| THEORY OF CHANGE 22
![Page 23: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/23.jpg)
• Regular camps
– As a dependable center for immunization
• Incentives:
– Encourage parents to immunize children
• Compare the new/revised program to the existing program
– How does the new program address the needs identified in the contextual analysis
– Does the new program address the shortcomings of the existing program
Formulating solutions
J-PAL| THEORY OF CHANGE 23
![Page 24: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/24.jpg)
1. Situation analysis – Specifying the context
2. Clarify the program goal
3. Design the program/product
4. Map the causal pathway
5. Explicate assumptions
6. Design SMART indicators
6 Steps to Building a ToC
J-PAL| THEORY OF CHANGE 24
![Page 25: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/25.jpg)
Increased full immunization rates
Step 2: Setting program goals
J-PAL| THEORY OF CHANGE 25
![Page 26: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/26.jpg)
Step 2: Setting the program goals
Situation/Context Analysis: High health worker absenteeism, low value of
immunization, limited income and time
GOAL I
N
C
R
E
A
S
E
D
I
M
M
U
N
I
S
A
T
I
O
N
J-PAL| THEORY OF CHANGE 26
![Page 27: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/27.jpg)
1. Situation analysis – Specifying the context
2. Clarify the program goal
3. Design the program/product
4. Map the causal pathway
5. Explicate assumptions
6. Design SMART indicators
6 Steps to Building a ToC
J-PAL| THEORY OF CHANGE 27
![Page 28: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/28.jpg)
Step 3: Describe the program
Regular immunization camps Incentives for full immunization
Solutions to address supply and demand-side constraints
28
![Page 29: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/29.jpg)
Step 3: Describe the program
Regular immunization Camps Incentives: 1 kilo of lentils per visit
+ steel plates
• A mobilized immunization team
conducted monthly
immunization camps in each
village
• Camps held on fixed date
once a month from 11am-2pm
• Social workers informed
mothers of the camp and the
benefits of immunization
• Parents were offered 1
kilogram of lentils per
immunization received (Rs 40)
• Parents were offered a set of
steel plates after the child was
fully immunized
Solutions to address supply and demand-side constraints
29
![Page 30: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/30.jpg)
Step 3: Describe the program
Situation/Context Analysis: High health worker absenteeism, low value of
immunization, limited income and time
GOAL
I
N
C
R
E
A
S
E
D
I
M
M
U
N
I
Z
A
T
I
O
N
Incentives for
immunization
Immunization
Camps
J-PAL| THEORY OF CHANGE 30
![Page 31: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/31.jpg)
1. Situation analysis – Specifying the context
2. Clarify the program goal
3. Design the program/product
4. Map the causal pathway
5. Explicate assumptions
6. Design SMART indicators
6 Steps to Building a ToC
J-PAL| THEORY OF CHANGE 31
![Page 32: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/32.jpg)
• Step-by-step laying out the theory connecting your
product/program to the goal
• Series of if…/then… statements forming results chain
Step 4: Mapping the Causal Pathway
J-PAL| THEORY OF CHANGE 32
![Page 33: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/33.jpg)
I
N
C
R
E
A
S
E
D
I
M
M
U
N
I
Z
A
T
I
O
N
Step 4: Building a Theory of Change
Incentives for
immunization Parents bring
children to
the camps
Immunization
Camps
Situation/Context Analysis: High health worker absenteeism, low value of immunization, limited income and time
GOAL
J-PAL| THEORY OF CHANGE 33
![Page 34: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/34.jpg)
Step 4: Building a Theory of Change
Full
Immuni-
zation
Incentives for
Immunization
Camps are
reliably open
Parents
bring
children to
the camps
Parents
bring
children to
the camps
repeatedly
GOAL OUTPUT OUTCOME
Resources for
Immunization
Camps
Incentives
are
delivered
INPUT
Situation/Context Analysis: High health worker absenteeism, low value of
immunization, limited income and time
J-PAL| THEORY OF CHANGE 34
![Page 35: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/35.jpg)
1. Situation analysis – Specifying the context
2. Clarify the program goal
3. Design the program/product
4. Map the causal pathway
5. Explicate assumptions
6. Design SMART indicators
6 Steps to Building a ToC
J-PAL| THEORY OF CHANGE 35
![Page 36: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/36.jpg)
Step 6: Explicate Assumptions
Assumptions are the key to unlocking the theory of change thinking
36
![Page 37: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/37.jpg)
I
N
C
R
E
A
S
E
D
I
M
M
U
N
I
Z
A
T
I
O
N
Theory of Change: Assumptions
Incentives for
Immunization Parents bring
children to the
camps
Immunization
Camps
Camp provides
immunizations
Parents value
incentives
Parents trust
camps
Incentives paid
regularly
Situation/Context Analysis: High health worker absenteeism, low value of immunization, limited
income and time
GOAL
J-PAL| THEORY OF CHANGE 37
![Page 38: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/38.jpg)
Step 4: Building a Theory of Change
Situation/Context Analysis: High health worker absenteeism, low value of immunization, limited
income and time
Full
Immuni-
zation
Incentives for
Immunization
Camps are
reliably open
Parents
bring
children to
the camps
Parents
bring
children to
the camps
repeatedly
GOAL OUTPUT OUTCOME
Resources for
Immunization
Camps
Incentives
are
delivered
INPUT
Parents value incentives
Parents trust camps
Incentives are paid regularly
J-PAL| THEORY OF CHANGE 38
![Page 39: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/39.jpg)
1. Situation analysis – Specifying the context
2. Clarify the program goal
3. Design the program/product
4. Map the causal pathway
5. Explicate assumptions
6. Design SMART indicators
6 Steps to Building a ToC
J-PAL| THEORY OF CHANGE 39
![Page 40: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/40.jpg)
• Indicators for each component
– Goal, outcome, output, input
• Indicators are
– Signals of change
– Measures of progress
Step 5: Design indicators
J-PAL| THEORY OF CHANGE 40
![Page 41: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/41.jpg)
• Quantitative and qualitative
• Standard of comparison (i.e. baseline v. endline, defining
“high-quality,” etc.)
• SMART
– Specific - Ask (answer) one question at a time
– Measurable - Quantifiable, accurate, unbiased,
sensitive
– Achievable - Is the indicator realistic?
– Relevant - Is this the most relevant program indicator
given the needs
– Time-bound – Measured over a period of time
Good Indicators
J-PAL| THEORY OF CHANGE 41
![Page 42: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/42.jpg)
OUTPUT OUTCOME
Step 6: Building a Theory of Change
INPUT
Increased Immunization
Rates
Immunization Camps + Incentives
Camps are open and
incentives are delivered
Parents bring children to the camps
Parents bring children to the camps repeatedly
AFTER 6 MONTHS
• 90% of program villages had running camps
• All health workers trained to offer parents incentives
AFTER 9 MONTHS
• Camps continue running in 90% villages
• Incentives were delivered to these camps
70-75% of parents brought children to be immunized
and reported receiving incentives
90 to 95% of parents who
immunized the children during the first round of immunization,
brought them to be immunized for the second round
At the end of the program
immunization rates were 38% in the
intervention villages as
compared to 6% in comparison
villages
GOAL
% of villages camps established
% of trained health workers
% camps open
% camps incentives delivered to
% of beneficiaries attending camps
% of beneficiaries receiving incentives
% of beneficiaries attending camps
repeatedly
% of children immunized
Situation/Context Analysis: High health worker absenteeism, low value of
immunization, limited income and time
J-PAL| THEORY OF CHANGE 42
![Page 43: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/43.jpg)
Convert to Log Frame
Objectives Hierarchy
Indicators Sources of Verification
Assumptions / Threats
Impact (Goal/ Overall
objective)
Increased immunization
Immunization rate (% of children immunized)
Household survey
Adequate vaccine supply, parents do not have second thoughts
Outcome (Project
Objective)
Parents attend the immunization camps repeatedly
% of beneficiaries attending follow up camps
Household survey; immunization card / attendance
Parents have the time to come
Outputs Immunization camps are reliably open;
Incentives are delivered
% camps open as scheduled; #
of kg bags delivered;
Camp administrative data; Random
audits
Nurses/assistants will show up to camp and give
out incentives properly
Inputs (Activities)
Camps + incentives are established
% of Camps built, % of camps functional
Random audits of camps
Sufficient materials, funding, manpower
Needs
assessment
Process
evaluation
Impact
evaluation
Needs
assessment J-PAL| THEORY OF CHANGE 43
![Page 44: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/44.jpg)
WHY IS THEORY OF CHANGE
IMPORTANT
![Page 45: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/45.jpg)
Example What is
it?
Componen
ts
Assumption
s
Conclusi
on
Why is Theory of Change Important
For evaluators, reminds us to
consider process
For implementers, it helps us be
results oriented
Increased
Immuni-
zation
Incentives for
Immunization
Camps are
reliably
Open Parents
bring
children to
the camps
Parents
bring
children to
the camps
repeatedly
GOAL OUTPUT OUTCOME
Immunization
Camps
Incentives
are
delivered
INPUT
J-PAL| THEORY OF CHANGE 45
![Page 46: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/46.jpg)
Solving the Black Box Problem
Mothers come back to camps
Mothers initially come to the camps
Intervention Intervention
design/Inputs
Activities
Outcome
s
Final
outcome
Assumptio
ns
Outputs
Regular camps held and
incentives procured
No increase in full immunization
Low immunization rates
Needs
Assessment
Black Box
![Page 47: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/47.jpg)
Inputs Activities Outputs Outcomes Goal
Inputs Activities Outputs Outcomes Goal
Inputs Activities Outputs Outcomes Goal
Identifying Theory Failure vs. Implementation
Failure
Successful intervention
Implementation failure
Theory failure
J-PAL| THEORY OF CHANGE 47
![Page 48: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/48.jpg)
Impact Results
6%
17%
38%
Control Camps Camps + Lentils
Immunization rates
J-PAL| THEORY OF CHANGE 48
![Page 49: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/49.jpg)
Making Policy from Evidence
National scale-up or global transfer?
• How representative is rural Rajasthan to the rest of India?
(Recall: 22% vs. 54% nationally)
– Same barriers to immunization?
• What about transferring this program to other countries/
contexts globally?
– How do we know if it’s relevant?
• Was the program cost effective?
J-PAL| THEORY OF CHANGE 49
![Page 50: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/50.jpg)
Costs per fully Immunized Child
Rs. 2202
Rs. 372
Rs 730
Immunization Camps Camps + Incentives
+
Cost of Incentive
Cost of Camp
J-PAL| THEORY OF CHANGE 50
![Page 51: Theory of Change - Abdul Latif Jameel Poverty Action Lab](https://reader031.vdocuments.us/reader031/viewer/2022012015/6159cd2cefb4f123b1551095/html5/thumbnails/51.jpg)
In summary
• A Theory of Change makes explicit how a program is
expected to achieve impact
• Its main components are the causal chain, assumptions,
and indicators
• Theory of Change can be used for both program as well
as evaluation design
J-PAL| THEORY OF CHANGE 51