key trends in alternative approaches to monitoring and evaluating sbc schooley

Key Trends in Alternative Approaches to Monitoring and

Evaluating Social and Behavior Change

Janine Schooley, MPH

Senior Vice President, Programs

CORE Fall Meeting, October 9, 2015

W W W . P C I G L O B A L . O R G

PCI’s experience in pushing the SBC

M&E envelope:

• Less donor-driven

• Less proving and more improving

• Learning from other disciplines

• Embracing the messiness

• Learning about measuring the hard to

measure

1


The Transformometer Idea

3


The Transformometer Idea cont’d

3

Counting Beneficiaries by Probability of Transformation

HIGH MODERATE LOWER

Any of these results indicate a high

probability of transformation,

particularly when service intensity is

high

Any of these results indicate a

moderate probability of

transformation, particularly when

service intensity is medium to low

Any of these results indicate a

low probability of

transformation, particularly

when service intensity is low

PCI interventions that… PCI interventions that… PCI interventions that…

Result in beneficiary being provider

of “new” services or information or

motivation to others that will likely

be sustained over time

Result in beneficiary being

provided with a service or process

that leads to attitude and/or

behavior change

Result in beneficiary being

a passive recipient of

information, education or

communication messages

Result in beneficiary engaging in

collective action or social advocacy

for his/herself, family or community

Reach an indirect beneficiary

through a direct beneficiary in the

moderate or high category of

transformation

Provide beneficiaries with

workshops or training with

minimal participation or

engagement

Result in beneficiary applying new

knowledge or skills outside of the

original area of intervention

Result in new or improved

services that meet a particular

beneficiary need

Serve beneficiaries very

minimally, eg. via one

exposure to mass media

outreach

Result in a significant improvement

in health, hunger and/or hardship

outcomes with likelihood of being

sustained

Result in an improvement in

health, hunger and/or hardship

outcomes but that have an

uncertain likelihood of being

sustained

Result in an unknown or

unclear benefit with

unlikely potential for

lasting attitude or behavior

change

High service intensity

(4 or more interventions)

Moderate service intensity (2-3

interventions)

Low service intensity

(1 intervention)


Measuring Sustainable Impact

Post project sustainability studies to understand,

learn from and improve the sustainability of our

impact:

• Bolivia DAP

• Bolivia USDA Food for Education

• South Africa Prevention in Action

• Indonesia Child Survival

• Planned: Ethiopia Women Empowered

• Planned: Botswana Building Bridges (local

capacity strengthening)

6


Measuring Social Change

Measuring social change through the Women

Empowered Initiative, BMGF-funded Parivartan

Program in India, Border Healthy Start, etc.:

• Individual and collective agency, efficacy

• Collective action

• Voice and social advocacy

• Social and human capital enhancement

• Cross generational outcomes

6

W W W . P C I G L O B A L . O R G 9

Lives Changed Indices (LCI)

A unique set of tools to measure the life-changing

impact of integrated programming:

• Application throughout the Women Empowered

Initiative

• Across a wide spectrum of economic, social

and behavioral characteristics – 7 modules

• Administered as a pre/post test and also with

case/control methodology

• Cellular-enabled data collection

• Moving from LCI 1.0 to 1.5 and now 2.0 and

beyond

Thanks!

[email protected]


key trends in alternative approaches to monitoring and evaluating sbc schooley

Healthcare