monitoring and evaluation of research communications- what’s it all about?

Monitoring and evaluation of research communications- what’s it all about?

Anna Downie, Information Department, IDS

Objectives for the session

To think about the purpose of evaluating communication strategies

To develop some measurable indicators

To identify data collection methods and monitoring processes

7

Learning & Reporting(Info to users/events/audiences)

Clarifying Intent(Both interventions & outcomes)

M&E Planning(Choosing what to track)

M&E Implementation (Data collection & interpretation)

Useful M&E needs…

8

Boundary partners

those individuals, groups, and organisations with whom the program:

interacts directly to effect change

anticipates opportunities for influence

engages in mutual learning

9

Outcome mapping: Nested spheres

Research project

Partners

Beneficiaries

Adapted from: Steff Deprez VVOB-CEGO, Nov 2006

sphere of ‘control’

sphere of influence

sphere of interest

Outcomes and indicatorsWho has seen the wind?

Neither I nor you.

But when the leaves hang trembling,

The wind is passing through.

Who has seen the wind?

Neither you nor I.

But when the trees bow down their heads,

The wind is passing by.

By Christina Rossetti (1830-1894)

A graduated set of statements describing a progression of changed behaviours in the boundary partner

Describe changes in actions, activities and relationships leading to the ideal outcome

Articulate the complexity of the change process

11

Progress markers

12

Progress markersLadder of change

Expanding influence, helping others, sharing expertise

Actively engaged, learning, commitment

Early encouraging response to program, initial engagement

Love to see

Like to see

Expect to see

Some indicators (suggested by Hilary)

References to work of partners in policy and finance statements

Statements and position papers

Commitments in national plans and finance strategies

Changes in position or attitudes

Resources commitments of finance or health ministers

Expenditure on contraception

Changes in SRH spending

Changes in services delivery

Charting choices for M&EUses

Adjust Strategy

Improve Implementation

Report Performance

Risk Management

Build Capacity

Lobbying

EventsAnnual Team

meeting

Annual ReportQuarterly

Report to Donor

3 year Programme

Review

Project Review Management

UsersProgram Staff

Board

Donor

Project

Partner

Programme Management

InfoStrategies

implemented

Morbidity & mortality

Partner actions in community

Community responses to project

Partner collaboration with ministry

Community participation

Funding flows

Who, what, when and how of evaluation

What data will you need to collect?

Who will collect it?

When will you collect it?

How often will you collect it?

Finally

Expecting the unexpected

Think about baselines

Don’t just seek the positive – Most significant

change

Learn from your learning

Share your learning– Peer review

18

For more information on Outcome Mapping:

www.outcomemapping.ca www.idrc.ca/evaluation

For more information on the Most Significant Change:

www.mande.co.uk/MSC

Further reading