where now? evaluation and evidence-based decision making jodi nelson impact planning and...
TRANSCRIPT
![Page 1: Where now? Evaluation and evidence-based decision making Jodi Nelson Impact Planning and Improvement, Global Development April 13, 2009](https://reader035.vdocuments.us/reader035/viewer/2022072006/56649d045503460f949d7adc/html5/thumbnails/1.jpg)
Where now?
Evaluation and evidence-based decision makingJodi Nelson
Impact Planning and Improvement, Global Development
April 13, 2009
![Page 2: Where now? Evaluation and evidence-based decision making Jodi Nelson Impact Planning and Improvement, Global Development April 13, 2009](https://reader035.vdocuments.us/reader035/viewer/2022072006/56649d045503460f949d7adc/html5/thumbnails/2.jpg)
© 2008 Bill & Melinda Gates Foundation
Agenda
• Introduction
• Opportunity
• Questions for you
![Page 3: Where now? Evaluation and evidence-based decision making Jodi Nelson Impact Planning and Improvement, Global Development April 13, 2009](https://reader035.vdocuments.us/reader035/viewer/2022072006/56649d045503460f949d7adc/html5/thumbnails/3.jpg)
Introduction Who am I?
• New to the foundation, not to evaluation
• NGO evaluation question: what difference do we make?
- International aid and the “evaluation gap”
- Tried pilots and larger scale evaluations among them rigorous impact evaluations in very challenging environments
- Lessons
- Not the evaluation approach, but the purpose and the questions
- Evaluation design is essential, but also how to use the findings?
- Randomization is not the hard part
© 2008 Bill & Melinda Gates Foundation
![Page 4: Where now? Evaluation and evidence-based decision making Jodi Nelson Impact Planning and Improvement, Global Development April 13, 2009](https://reader035.vdocuments.us/reader035/viewer/2022072006/56649d045503460f949d7adc/html5/thumbnails/4.jpg)
Introduction Bill & Melinda Gates Foundation
• We invest in opportunities to take innovation to scale
• What works and how can solutions be brought to scale ?
• What makes people change their behavior?
• Is it the evidence? Is it the timing of the evidence?
• We value sustainabilty
• How can we ensure that changes endure?
• How can we spur big changes in complex systems?
© 2008 Bill & Melinda Gates Foundation
![Page 5: Where now? Evaluation and evidence-based decision making Jodi Nelson Impact Planning and Improvement, Global Development April 13, 2009](https://reader035.vdocuments.us/reader035/viewer/2022072006/56649d045503460f949d7adc/html5/thumbnails/5.jpg)
IntroductionEvaluation at the Foundation
• A priority…
• Link to strategy: Impact Planning & Improvement
• Leadership: Sponsorship from the top
• Practical : “Actionable Measurement”
• Big questions remain
• How much to wade into RCTs?
• What burden of proof is necessary?
• How to walk the intersection between practicality and rigor?
© 2008 Bill & Melinda Gates Foundation
![Page 6: Where now? Evaluation and evidence-based decision making Jodi Nelson Impact Planning and Improvement, Global Development April 13, 2009](https://reader035.vdocuments.us/reader035/viewer/2022072006/56649d045503460f949d7adc/html5/thumbnails/6.jpg)
© 2008 Bill & Melinda Gates Foundation
The Opportunity: Evaluating Global Development
- Focused discussion at high levels about evaluation and evidence-based decision making
- Recognition that “impact” is a term to take seriously
- Evaluators with theoretical and field experience
- Applied research in social science increasingly focused on development
- Awareness that data is a public good (LSMS)
- Initiatives (3IE, NONIE and others) seeking to build up evidence base
![Page 7: Where now? Evaluation and evidence-based decision making Jodi Nelson Impact Planning and Improvement, Global Development April 13, 2009](https://reader035.vdocuments.us/reader035/viewer/2022072006/56649d045503460f949d7adc/html5/thumbnails/7.jpg)
Opportunity todayTo listen to and learn from you
• How do you envision the relationship between the need to answer specific questions about ‘what works’ and the need that users/practitioners/policymakers have to make timely decisions?
• Where is the balance between evaluating “impact” in terms of the net effect of a specific policy, innovation or intervention, and tracking the progress of development over time? How do we connect micro and macro?
© 2008 Bill & Melinda Gates Foundation
![Page 8: Where now? Evaluation and evidence-based decision making Jodi Nelson Impact Planning and Improvement, Global Development April 13, 2009](https://reader035.vdocuments.us/reader035/viewer/2022072006/56649d045503460f949d7adc/html5/thumbnails/8.jpg)
THANK YOU