m&e tool for ngo capacity buildingngo capacity building workshop september 2010 presented by...

27
www.chfinternational.org M&E Tool for NGO Capacity Building NGO Capacity Building Workshop September 2010 Presented by Carlene Baugh

Upload: others

Post on 21-Jan-2021

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

M&E Tool for NGO Capacity Building

NGO Capacity Building Workshop

September 2010

Presented

by

Carlene Baugh

Page 2: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

• Gain awareness of:

– Framework for achieving program effects

– A tool for tracking capacity building

• Identify:

– How the tool can be applied in your NGO

capacity building program (s)

At the end of the session participants will

Page 3: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Let’s look at some

FRAMEWORKS!

Page 4: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Causal Chain

Inputs Activities Outputs Outcomes Impacts

Page 5: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Capacity Development

Individual

•Development Professionals

•Civil Society Leaders

•Youth

•Change Agents

Organization

• Community Based Organizations

• Non-Governmental Organizations

• Government departments

• Social enterprises

• Businesses

System

• Communities

• National Health systems

• National level civil society

• Governmental Coordination Systems

Eco-System

• Societies

• The full gamut of individuals, organizations, networks and systems

• Cross-functional

• Cross sectoral

• Cross-hierarchical

Page 6: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.orgSpringfield Centre |

Making markets work

SUPPORTING

FUNCTIONS

RULES

LawsStandards

Information

Informing &

communicating

Setting &

enforcing rules

Business

membership

organisations

Government

Private sector

Not-for-profit sector

Informal

networks

MARKET PLAYERS

Demand SupplyCORE

Enabling Environment

Page 7: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Traditional Program characteristics:

Judge success or failure

Measure against fixed goals

External for objectivity

Linear cause/effect models

Accountability to external

Accountability for control, blame

Engender fear of failure

Developmental\Systemic

approach

Provide feedback for improvement

New measures as goals evolve

Internal, integrated, interpretive

Seek to capture system dynamics

Accountability to values, commitments

Understand & respond strategically

Feed hunger for learning

Adapted from: Patton, Michael Q., 2006, “Evaluation for the Way We Work”,

The Nonprofit Quarterly, Spring.

Page 8: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Key messages

Page 9: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

• See yourself as a

part of a

interconnected

web of

relationships and

systems

Look at the bigger picture

Key Messages or themes

Page 10: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Recognizing that change is…

• Continuous

• Complex

• Non-linear

• Multi-directional

• Not controllable

Key Messages or themes

Page 11: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Keeping your eyes wide open

• Being attentive

along the journey

is as important as

the destination

Key Messages or themes

Page 12: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Contribution not attribution

• your influence on a

better world

• you can influence

but not control

change in your

partners

Key Messages or themes

Page 13: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

What is Outcome Mapping

• An M&E tool developed by IDRC

• Shift from assessing the products of a

program TO:

Behavior change: relationships, or

actions of the people, groups, and

organizations with whom a program works

directly and those within its sphere of

influence.

Page 14: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

What is Outcome Mapping

• Assesses the contributions of

development programs make to the

achievement of outcomes

• Learning-based and use-driven guided by

principles of participation and iterative

learning throughout the program life-cycle

• Program, project or organizational levels

Page 15: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

What is Outcome Mapping

• Focuses on monitoring and evaluating its

results in terms of the influence of the

program on the roles these partners play

in development

Page 16: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Outcome Mapping

Defines the program’s outcomes as changes in

behaviors of direct partners

Focuses on how programs facilitate

change rather that how they caused change

Recognizes the complexity of

development processes together with the

contexts in which they occur

Boundary Partners

Individuals, groups or organizations with whom

the program interacts directly to effect change

Page 17: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

3 Stages

Page 18: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Focus on direct partners• Key concept is

« boundary partners »

• The individuals, groups,

and organizations you

work with directly and

anticipate opportunities

for influence

Page 19: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Examples

• Local communities (NGOs, indigenous

groups, churches, community leaders)

• Government officials and policymakers

(department, regional administration)

• Private sector (tourism, fisheries, non-

timber forest products, logging and wood

processing companies)

Page 20: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Example

• Outcome Challenge: The program

intends to see local communities that

recognize the importance of, and are

engaged in, the planning of resource

management activities in partnership with

other resource users in their region

Page 21: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

progress markers =

ladder of change

Love to see

Like to see

Expect to see

Page 22: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Progress markers

✓ A graduated set of statements describing a

progression of changed behaviors in the

boundary partner

✓ Describe changes in actions, activities and

relationships leading to the ideal outcome

✓ Shows story of change by articulating the

complexity of the change process

✓ Can be monitored & observed

✓ Permit on-going assessment of partner’s

progress (including unintended results)

Page 23: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Performance M&E

• Monitoring 3 elements

– Changes in behaviors, actions, relationships,

groups (outcome journal)

– Strategies to encourage change in its

partners (strategy journal)

– Functioning of a program as an

organizational unit (performance journal)

Each of these monitoring tools builds on elements from the Intentional

Design stage, so the group should feel relatively comfortable with them.

Page 24: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Performance Journal mtg

– What are we doing well and what should we

continue doing?

– What are we doing “okay” and what can we

improve?

– What do we need to add to better address the

organizational practices?

– What activities do we need to modify

– Who is responsible? What are the time lines?

– Has any issue come up that we need to

evaluate in greater depth? What? When?

Why? How?

Page 25: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Outcome journal

To understand the change process in boundary

partners. Collects information about:

• Story of change and reasons for change

• Unexpected changes

• The actors and factors that contributed to that

change

• How we know the change occurred

• Learnings (what? how? why?)

Page 26: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

References

• Building learning and reflection into

development programs (Sarah Earle, Fred

Carden & Terry Smutylo, 2001)

• Outcome Mapping Learning Community

http://www.outcomemapping.ca/

Page 27: M&E Tool for NGO Capacity BuildingNGO Capacity Building Workshop September 2010 Presented by Carlene Baugh. •Gain awareness of: –Framework for achieving program effects –A tool

www.chfinternational.org

Feedback & Questions