evalueringskonferansen 2013: niels dabelstein
DESCRIPTION
Niels Dabelstein 19.09.13: Designing for effective evaluation feedbackTRANSCRIPT
![Page 1: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/1.jpg)
E V A L U E R I N G S K O N F E R A N S E N 2 0 1 3 D R A M M E N , N O R G E N I E L S D A B E L S T E I N
DESIGNING FOR EFFECTIVE EVALUATION FEEDBACK
![Page 2: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/2.jpg)
2
“I can honestly say that not a day goes by when we don’t use those evaluations in one way or another.”
Written by Mark M. Rogers and illustrated by Lawson Sworh
![Page 3: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/3.jpg)
DEFINITION OF EVALUATION (DAC)
An assessment, as systematic and objective as possible, of an on-going or completed project, programme or policy, its design, implementation and result.
- to determine the relevance and fulfilment of objectives, developmental efficiency, effectiveness, impact and sustainability.
- be credible, timely, and useful, enabling the incorporation of lessons learned into the decision-making process of recipients and donors.
![Page 4: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/4.jpg)
USEFULNES/UTILITY
Evaluation must serve the information needs of the intended primary users.
![Page 5: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/5.jpg)
MULTIPLE TARGET GROUPS (USERS)
• Internal: • Management • Operational staff • Partners
• External:
• Parliament/policy makers • Opinion makers/leaders • General public • Academics/researchers/students • External Resource base • NGOs
![Page 6: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/6.jpg)
INTERNAL FEEDBACK
• Follow-up Memo • Department/Senior management
• Discussion in Management group • Workshops / Seminars / Training • Contribute to policy, strategy & guidelines • Annual report to Board
![Page 7: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/7.jpg)
EXTERNAL DISSEMINATION
• Evaluation Report • 4 page summary • Presentations in partner countries • 25 page ”popular version” (in local languages) • Press conference/seminar • Video/film • Eval’s annual report to Board • Danida’s annual report • Udvikling – Danidas bi-monthly magazine • Public meetings/Professional Associations • Lectures Universities/high Schools • WWW
![Page 8: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/8.jpg)
THE EVALUATION OF THE PARIS DECLARATION
In 2005 130+ countries’ donors and agencies committed to improve development effectiveness by improving:
•Ownership •Alignment •Harmonization •Managing for Results •Mutual Accountability
![Page 9: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/9.jpg)
A JOINT EVALUATION
• Based on the principles of the Paris Declaration: partner countries and development partners developed the evaluation framework/approach jointly
• The evaluation itself was a tool for mutual accountability: • 22 Country-level evaluations led by partner countries and
managed in-country
• 18 Donor/agency HQ studies
![Page 10: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/10.jpg)
EVALUATION COMPONENTS
![Page 11: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/11.jpg)
Country Evaluations & Donor Studies
![Page 12: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/12.jpg)
ENSURING UTILITY
• Legitimacy of the evaluation (mandate) • Genuine participation of primary stakeholders • Transparency, communication and knowledge
sharing. http://www.oecd.org/dac/evaluation/PDE
• Dissemination /communication strategy • Plain language (trilingual) • Timeliness
![Page 13: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/13.jpg)
TENSIONS # 1
The tension between stakeholder involvement and evaluator independence impartiality.
![Page 14: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/14.jpg)
![Page 15: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/15.jpg)
15
![Page 16: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/16.jpg)
TENSION # 2
The tension between strength of evidence and delivering the findings on time
![Page 17: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/17.jpg)
A BALANCING ACT: STRENGTH OF EVIDENCE VS. TIMELINESS
17
On Time
![Page 18: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/18.jpg)
DISSEMINATION INSTRUMENTS
• 55 Reports (synthesis (2), country and donor evaluations, special studies, meta evaluation)
• Free standing summaries of synthesis reports • 9 Thematic policy briefs (5+4) • Everything on www • 36 national and international meetings and
workshops • Video and film on www and Facebook
![Page 19: Evalueringskonferansen 2013: Niels Dabelstein](https://reader033.vdocuments.us/reader033/viewer/2022060115/557c79bcd8b42a494c8b4e87/html5/thumbnails/19.jpg)
USEFUL LINKS
www.oecd.org/dac/evaluation/evaluationofthe implementationoftheparisdeclaration.htm www.evaluering.dk