outcome mapping: monitoring and evaluation tool

19
Outcome Mapping: Monitoring and Evaluation Tool Mini Symposium on Outcome and Impact Assessment, R4D Planning week. Emily Ouma. 24 November 2010.

Upload: international-institute-of-tropical-agriculture

Post on 14-Dec-2014

2.379 views

Category:

Business


1 download

DESCRIPTION

A method for planning and assessing the social effects and internal performance of projects, programs, and organizations.“A project should see itself as a part of an interconnected web of actors, factors and relationships” (Sarah Earl, 2008 IDRC)

TRANSCRIPT

Page 1: Outcome Mapping: Monitoring and Evaluation Tool

Outcome Mapping: Monitoring and Evaluation Tool

Mini Symposium on Outcome and Impact Assessment, R4D Planning week.

Emily Ouma.

24 November 2010.

Page 2: Outcome Mapping: Monitoring and Evaluation Tool

Linear-based cause and effect frameworks

1.Difficulty in attributing development impacts to the outputs provided by individual projects – new modalities of cooperation.

2.Principle of linear causality seen as too rigid and unrealistic as a basis for planning and management

also depends on endogenous socio-cultural, economic, political, and environmental factors of the project.

Page 3: Outcome Mapping: Monitoring and Evaluation Tool

Origins of Outcome Mapping

• 1990’s: IDRC had a need to demonstrate results.

• 1998: Discovered Outcome Engineering – used to plan and measure the results of drug rehabilitation.

• 2000: publication of the OM manual in English

• Global training & using OM globally.

• 2006: www.outcomemapping.ca

Page 4: Outcome Mapping: Monitoring and Evaluation Tool

Outcome Mapping

A method for planning and assessing the social effects and internal performance of projects, programs, and organizations.

Looks at the bigger picture“A project should see itself as a part of an interconnected web of actors, factors and relationships” (Sarah Earl, 2008 IDRC)

Page 5: Outcome Mapping: Monitoring and Evaluation Tool

Outcome Mapping

• Focus is on a particular category of results:– Changes in behaviors of people, groups and

organizations with whom a project/program works directly. Referred to as “Outcomes”.

– Development projects/programs can claim contributions to achievement of outcomes rather than attribution of development impacts.

Page 6: Outcome Mapping: Monitoring and Evaluation Tool

Underlying principles of Outcome Mapping

Contribution rather than attribution.

Focuses on the logical links between interventions and behavioural change.

Changes are complex and are not linear, – not based on a cause–effect framework, it

recognizes that multiple, nonlinear events lead to change.

Page 7: Outcome Mapping: Monitoring and Evaluation Tool

Underlying principles of Outcome Mapping

Development is done by and for the people.A project can:

– influence achievement of outcomes but – cannot control them as the ultimate

responsibility rests with people affected

Page 8: Outcome Mapping: Monitoring and Evaluation Tool

Outcome Mapping Terminologies• Boundary partners

– The individuals, groups, and organizations with whom a project interacts directly to effect change and with whom the project can anticipate some opportunities for influence.

• Outcome challenge

– Describes how behaviors, relationships, activities, actions of an individual, group, or institution will change if the project is successful.

Love to see

Like to see

Expect to see

• Progress markers- A gradual set of milestones describing a progression of changed behavior in a project partner.

Page 9: Outcome Mapping: Monitoring and Evaluation Tool

Boundary partners

PROGRAM

Boundary partner

THE REAL WORLD

Page 10: Outcome Mapping: Monitoring and Evaluation Tool

Relative Influence along the Results Chain

Behavioural Changes (focus of OM)

Endogenous actors

Project/program

Low

High

(Community ownership and capacity increases)

(Project ownership declines)

Inputs Activities Outputs Outcomes Impacts

Page 11: Outcome Mapping: Monitoring and Evaluation Tool

Outcome Mapping Framework

How do we know we are on-track?

What do we want to learn?

What are we trying to accomplish and how?

Page 12: Outcome Mapping: Monitoring and Evaluation Tool

Project(performance journal)

Boundary Partners

(outcomes journal)

Spheres of M&E with Outcome Mapping

Relevance and viability

(of the project)Internal practices in order to

remain effective

Implementation (interventions by the project)

Outcomes (behaviour changes in the partners)

Strategies(strategy journal)

Page 13: Outcome Mapping: Monitoring and Evaluation Tool

Primary Uses of Outcome Mapping

PlanningArticulate goals & define activities

MonitoringTrack project performance & partners’ progress

EvaluationDesign & conduct a use-oriented evaluation

Page 14: Outcome Mapping: Monitoring and Evaluation Tool

Methodologically, what does Outcome Mapping bring in?

Focus on measurable outcomes.- Clear formulation of responsibilities, roles and measurable

milestones. - Each boundary partner develops a set of activities

(milestones) that allow for RBM.

Focus on learning and participation.- Iterative and participatory planning for learning based

management.- Information management involving all stakeholders.

Page 15: Outcome Mapping: Monitoring and Evaluation Tool

Expanding accountabilities.

Using OM for M&E can help in managing multiple accountabilities (up, down, internal) by:

– being able to document & communicate outcomes.– engagement in social learning with boundary partners,

thereby anhancing ownership.

Methodologically, what does Outcome Mapping bring in?

Page 16: Outcome Mapping: Monitoring and Evaluation Tool

Drawbacks of Outcome Mapping

• “Changes in behavior” (though fundamental to sustainable development) cannot be an objective or an end in itself.– Behavior changes should induce higher level

improvements in situations at a higher level.

• It requires that project structures and activities constantly adapt to changing context (“fluidy”).

Page 17: Outcome Mapping: Monitoring and Evaluation Tool

Towards a synthesis of LFA, and OM frameworks? (Roduner et al., 2008)

Page 18: Outcome Mapping: Monitoring and Evaluation Tool

Accountability and Learning: A Balancing Act

Page 19: Outcome Mapping: Monitoring and Evaluation Tool

Thank You