monitoring and evaluation of research communications- what’s it all about?
DESCRIPTION
Presentation given by Anna Downie at a research communications capacity building workshop held at IDS April 2008.TRANSCRIPT
![Page 1: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/1.jpg)
Monitoring and evaluation of research communications- what’s it all about?
Anna Downie, Information Department, IDS
![Page 2: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/2.jpg)
Objectives for the session
To think about the purpose of evaluating communication strategies
To develop some measurable indicators
To identify data collection methods and monitoring processes
![Page 3: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/3.jpg)
![Page 4: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/4.jpg)
7
Learning & Reporting(Info to users/events/audiences)
Clarifying Intent(Both interventions & outcomes)
M&E Planning(Choosing what to track)
M&E Implementation (Data collection & interpretation)
Useful M&E needs…
![Page 5: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/5.jpg)
8
Boundary partners
those individuals, groups, and organisations with whom the program:
interacts directly to effect change
anticipates opportunities for influence
engages in mutual learning
![Page 6: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/6.jpg)
9
Outcome mapping: Nested spheres
Research project
Partners
Beneficiaries
Adapted from: Steff Deprez VVOB-CEGO, Nov 2006
sphere of ‘control’
sphere of influence
sphere of interest
![Page 7: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/7.jpg)
Outcomes and indicatorsWho has seen the wind?
Neither I nor you.
But when the leaves hang trembling,
The wind is passing through.
Who has seen the wind?
Neither you nor I.
But when the trees bow down their heads,
The wind is passing by.
By Christina Rossetti (1830-1894)
![Page 8: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/8.jpg)
A graduated set of statements describing a progression of changed behaviours in the boundary partner
Describe changes in actions, activities and relationships leading to the ideal outcome
Articulate the complexity of the change process
11
Progress markers
![Page 9: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/9.jpg)
12
Progress markersLadder of change
Expanding influence, helping others, sharing expertise
Actively engaged, learning, commitment
Early encouraging response to program, initial engagement
Love to see
Like to see
Expect to see
![Page 10: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/10.jpg)
Some indicators (suggested by Hilary)
References to work of partners in policy and finance statements
Statements and position papers
Commitments in national plans and finance strategies
Changes in position or attitudes
Resources commitments of finance or health ministers
Expenditure on contraception
Changes in SRH spending
Changes in services delivery
![Page 11: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/11.jpg)
Charting choices for M&EUses
Adjust Strategy
Improve Implementation
Report Performance
Risk Management
Build Capacity
Lobbying
EventsAnnual Team
meeting
Annual ReportQuarterly
Report to Donor
3 year Programme
Review
Project Review Management
UsersProgram Staff
Board
Donor
Project
Partner
Programme Management
InfoStrategies
implemented
Morbidity & mortality
Partner actions in community
Community responses to project
Partner collaboration with ministry
Community participation
Funding flows
![Page 12: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/12.jpg)
Who, what, when and how of evaluation
What data will you need to collect?
Who will collect it?
When will you collect it?
How often will you collect it?
![Page 13: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/13.jpg)
Finally
Expecting the unexpected
Think about baselines
Don’t just seek the positive – Most significant
change
Learn from your learning
Share your learning– Peer review
![Page 14: Monitoring and evaluation of research communications- what’s it all about?](https://reader031.vdocuments.us/reader031/viewer/2022020207/5494412bb47959424d8b4a8d/html5/thumbnails/14.jpg)
18
For more information on Outcome Mapping:
www.outcomemapping.ca www.idrc.ca/evaluation
For more information on the Most Significant Change:
www.mande.co.uk/MSC
Further reading