MONITORING LEARNING AND EVALUATION

CAPABILITY STATEMENT

2019

Capability Statement – MEL Services

1

Monitoring, Evaluation & Learning Capability Statement IMC’s Monitoring, Evaluation and Learning (MEL) team supports partners to evaluate and communicate impact in increasingly complex programme contexts, providing efficient and effective cross-cutting monitoring, evaluation and research services. Our dedicated in-house team of over 20 experts located in the UK and the US bring a diversity of regional, technical and thematic experience. With a portfolio spanning over 100 countries across the globe, we collaborate with a wide network of local partners, specialists, academic institutions, centers of excellence and data science companies. Our technical expertise includes real-time continuous monitoring and reviews, operational research and evaluation before, during, and after project completion, capacity development, evidence

uptake, innovation and technology use, better data utilisation, knowledge management and communications. IMC has been at the forefront of recognising the potential that technology holds for development outcomes, and has adopted technology to enhance programme delivery, as well as implementing technology focused programmes. Thematic expertise includes gender and social inclusion, livelihoods development, humanitarian response and fragile and conflict-affected states, climate change, infrastructure and transport, water and sanitation and private sector investment.

Capability Statement – MEL Services

2

OUR SERVICES PROGRAMME EVALUATION IMC delivers customised, high-quality evaluations with evidence-based recommendations to improve processes, structures and strategies. Our evaluations employ rigorous quantitative and qualitative methods, and engage stakeholders to ensure relevance, accuracy, and use of the evidence produced. MONITORING, KNOWLEDGE MANAGEMENT, LEARNING AND UTILISATION We place the usefulness of evidence at the centre of our work, informing how we gather data, present evidence and promote learning. We employ a range of learning and knowledge sharing methods to strengthen creation, access and use of relevant data to improve programme performance. IMC assesses MEL ecosystems within organisations in order to help clients modify existing approaches or develop new systems. In doing so, we help our clients collect, manage and use data resulting in more informed programmes and increased impact. In conjunction with our Communications Team, we have established strong expertise in facilitating programme and sector-wide learning in the development space. ENABLING TECHNOLOGIES AND DATA SCIENCE ADVISORY SERVICES IMC leverages technology to ensure the effective and efficient delivery of programmes. We advise on the deployment of information technology systems and infrastructure that supports programming and data collection processes. IMC’s data science professionals and research experts ensure the tools, frameworks and indicators we contribute to are rigorous, pertinent and methodologically sound. RESEARCH AND TECHNICAL ADVISORY IMC undertakes large-scale research projects, which inform future programming, policies and strategies. Drawing from our own experience delivering evidence-based evaluations of development and humanitarian aid programmes, our technical subject matter experts ensure tools, frameworks and indicators are rooted in international best practices. CAPACITY BUILDING AND ORGANISATIONAL DEVELOPMENT IMC delivers capacity building and organisational development activities, from face-to-face training to virtual reality simulations and application of learning processes. Our experts also assist in developing organisational structures to support sustainable, locally-driven outcomes.

Our expertise covers a range of specific areas: • Design of Theories of Change (including

indicators), MEL frameworks, toolkits, and approaches to adaptive programming.

• Undertake thematic syntheses and research and technical advisory work.

• Undertake complex large-scale, multi-country evaluations and more focused, single country evaluations before, during and after project completion.

• Strengthen utilisation, learning and knowledge- sharing approaches and tools.

• Capacity building and facilitation on MEL, policy engagement, knowledge sharing and learning.

• Apply enabling technologies and data science advisory for more effective data collection, management, analysis and use.

• Design and delivery of indicators, customised robust data collection tools and simple reporting methods.

• Provide quality assurance reviews to evaluation terms of reference, data collection tools and frameworks, and reports.

• Qualitative and quantitative longitudinal and cross-sectional impact surveys.

RECENT AND ONGOING PROJECTS EVALUATIONS BRACE 2 (DFID, South-Sudan, 2017-2019) The M&E team is building capacity of BRACE II Implementing Partners (IPs) to produce robust evidence and learning and to promote a greater level of transparency, participation, accountability and local ownership. The IMC-led consortium is tasked to produce robust evidence and learning, to establish a feedback mechanism that gives communities a voice and enables two-way communication and accountability to improve delivery; and to conduct independent M&E focusing on delivery, effectiveness, comparing and learning. Some of the activities include: collaborative design and revision of M&E systems; capacity building activities; VfM strategy support; strategic programme learning; independent programme evaluations, monitoring missions, and learning and action workshops. What Works to Prevent Violence Against Women and Girls (DFID, Global, 2016-2019) The IMC-led Performance Evaluation assesses research production and research uptake in this multi-country DFID programme on VAWG in Africa and Asia. The mid-term review was completed in 2017 and the Evaluation Team have produced Research Uptake Progress. In addition the team are bringing together lessons and adding value through capacity development activities, such as attending the Annual Scientific Meeting to share findings and recommendations.

Capability Statement – MEL Services

3

This evaluation applies a Realist approach to verify whether research generated from the programme produces high-quality contextualised evidence and furthermore, assesess how well the research is being communicated to and used by policy makers to address VAWG more effectively. The Evaluation incorporates three thematic case studies to review various projects funded by the What Works programme, including VAWG prevention, research projects, evaluations of existing interventions, and a grants scheme to support innovation in programming. Making All Voices Count: A Grand Challenge for Development (DFID, Global, 2013-2017) IMC is leading the Evaluation Management Unit for the Making All Voices Count (MAVC), a $45m fund to support innovation, scaling-up and research in the use of technology and non-technology approaches to support open, responsive government and citizen engagement. IMC is delivering the design of the monitoring and evaluation framework and systems, along with a set of portfolio, process and project level evaluations across four funding windows that cover 370 projects in 12 countries in Africa and Asia. This involves formative, summative and developmental evaluations outcome mapping, contribution analysis, participatory tools and use of open data sources. IMC has carried out case based studies in Indonesia, Kenya, South Africa and Ghana at

project level, along with annual reviews of the programme, through synthesis of global M&E data, case study findings and process level study. UNFPA Humanitarian Capacity (UNFPA, Global, October 2018-ongoing) IMC is evaluating UNFPA’s Humanitarian Capacity. Every year UNFPA responds to an average of 60 emergencies. Implementing UNFPA’s mandate in emergency situations helps to ensure that reproductive health and rights of the affected population are met and decreases the risks of sexual violence and exploitation. The purpose of the evaluation is to provide an independent, external and objective assessment of UNFPA’s capacity in humanitarian action, both in terms of preparedness and response. UNFPA’s response to the Syrian Crisis (UNFPA, Egypt, Iraq, Jordan, Lebanon, Syria and Turkey, November 2017-ongoing) The purpose of this evaluation is to assess the contribution of UNFPA to the Syria humanitarian crisis response. A subsequent purpose is to generate findings and lessons that will be of use for UNFPA (at global, regional and country level) but also for humanitarian actors, countries affected by the Syria crisis, donors, and the civil society. The summative aspect of this evaluation is to ensure accountability at all levels within the UNFPA Response. The formative and forward-looking aspects of this evaluation will identify good practice, key lessons learnt, and generate recommendations for the future UNFPA Responses.

Capability Statement – MEL Services

4

GATE-GEC Project (Plan International, Sierra Leone, September 2017-June 2018) Plan International is leading a consortium of four organizations implementing the GATE-GEC project in Sierra Leone. IMC is working on the baseline evaluation to track two key transition points: Primary to Junior Secondary School and Junior Secondary School to Senior Secondary School and other successful transition points, across 452 schools in Sierra Leone. Understanding Complementary Basic Education, (DFID, Ghana, September 2016-December 2018) The research and impact evaluation demonstrates IMC’s ability to deliver ‘nimble’ mixed methods longitudinal evaluations, by using qualitative interviews, pedagogical observation, as well as household survey data collection and learner assessments based on international best practice (EGRA and EGMA). The evaluation used propensity score matching to look at the impact of the CBE programme on children’s progression. Importantly, IMC closely engaged with the Ghanaian Ministry of Education throughout the assignment, and the final conclusions, recently presented at a Final Research and Lesson Learning Conference Workshop in Ghana, played a central role the Ministry’s decision to take over the funding of CBE.

Integrating Gender Considerations into Climate Resilience Policy and Investment Planning (EBRD, Tajikistan, 2018-2019) IMC undertook an evaluation and learning activity to assess how gender considerations were integrated into the policy level activities and into the design and implementation of private sector-focused adaptation investments in Tajikistan. IMC carried out a representative survey of 400 sub-borrowers (SMEs, farms and households) of loans for climate resilient technologies. Focus groups and key informant interviews were carried out to a range of senior stakeholders including staff from government departments, private sector associations and civil society organisations. The team delivered evidence on what works which will help progress effective gender integration in the private sector; and provided guidance and lessons on identified best practices. A Knowledge and Dissemination Strategy was developed to facilitate learning and promote knowledge. This included “champions” to enhance ownership and maximise the outreach of the findings and guidelines beyond the life of the intervention.

Capability Statement – MEL Services

5

LEARNING & RESEARCH Evidence and Learning Facility in South-Sudan (ELFSS) (DFID, South-Sudan, 2017-2020) The IMC led consortium has been comissioned to manage the monitoring, evaluation, research, analysis and knowledge management of the Humanitarian and Resilience Programme in South Sudan (HARISS). IMC and its partners will strenghten the enabling environment for evidence and learning, generate robust and relevant evidence and support adaptive programming, informed decision-making and improved impacts. Key activities include: systematic reviews, third party monitoring, topical and thematic studies, data aggregation and synthesis, development and management of digital architecture, capacity building of implementing partners to collect, analyse, report, and reflect on their own practice. Violence Against Women and Girls (DFID, Nepal-Pakistan-Myanmar, 2015-2017) This research programme focused on generating evidence around how income has an impact on women’s view of and resilience to forms of violence. IMC used a mixed-methods approach gathering both quantitative and qualitative data. The study generated new research that offered clear policy and programme direction on how WEE can be used as a vehicle to mitigate and reduce VAWG.

Nutrition and Education Cluster Experiences and Learning for Transition (UNICEF, Global, November 2014-March 2015) The purpose of the review was to document select country cluster characteristics, experiences, and learning around the transition of humanitarian coordination functions in the nutrition and education sectors from externally supported Clusters to nationally managed and sustained platforms. IMC provided practical guidance for both sectors and explored implications for UNICEF’s approach to transition more generally. The assignment included an in-depth document review of Education and Nutrition Cluster coordination structures and their characteristics; field visits to Pakistan and Palestine for the Education Cluster and to Kenya and the Philippines for the Nutrition Cluster; and an additional six in-depth, desk-based country case studies. The review culminated in the development of guidance and benchmarks for transition of Cluster functions to nationally led entities in both sectors.

Capability Statement – MEL Services

6

MONITORING Accelerate Caribbean (World Bank, The Caribbean, 2015–2016) IMC developed and used a monitoring and learning framework to monitor progress against outputs, outcomes, contribution to impact and the identification of key lessons. We developed a set of tools to monitor progress; we produced a set of case studies to learn on the successes, good practices and challenges of supporting business incubators in the Caribbean and we conducted an end of programme review to gather stakeholder’s input on programme strengths, challenges and lessons. Gateway Academy (World Bank, Sub-Saharan Africa, 2016 – on going) IMC is working with the Consultative Group to Assist the Poor (CGAP) on its development of the Gateway Academy (the Academy) at the World Bank. To assist CGAP, IMC used a developmental evaluation approach which provides information and feedback on key performance indicators quickly to CGAP staff. Swift access to new information allows managers, platform administrators and curriculum designers to make decisions in real-time that improve platform performance and learner success. Developmental evaluation requires an agile approach to programme monitoring and performance evaluation and requires the use of data collection tools and informant interviews in the eight countries where the Gateway Academy has been piloted. Transforming Rural Wash (DFID, Mozambique, 2016-2020) IMC is providing monitoring and evaluation technical support and verification services to DFID Mozambique for their Transforming Rural WASH Programme. This includes providing in-depth quality assurance in the development of a comprehensive monitoring and Value for Money framework. IMC is also delivering the monitoring of results against an independent monitoring framework. This is a process by which Government monitoring processes, capabilities and reported results are assessed every six months to facilitate payment by results. The independent monitoring framework takes a mixed-methods approach, using quantitative and qualitative approaches to assess progress against 18 Key Performance Indicators, extensive surveying and participatory assessments, key informant interviews and technical observation underpin the research and recommendations to DFID.

Conflict Stability and Security Fund (CSSF) (FCO, West Africa, 2018-2021) IMC, in partneship with WYG Group, are supporting the enhancement of CSSF results management process and better articulation of the strategic and programmatic impact of interventions. IMC will contribute to build a robust evidence base to strengthen learning of what works across project, portfolio and thematic areas. This will be achieved through: ensuring appropriate Theories of Change, results frameworks and value for money metrics at the portfolio and country level, to show aggregate data and results within and across each portfolio; developing MEL systems/processes building on needs, operational realities and budget limitations; building MEL capacity. Moving Energy Initiative II (Energy 4 Impact, Global, 2016-2019) IMC was commissioned by Energy 4 Impact to be the M&E and research partner of the Moving Energy Initiative (MEI) which aims to improve access to sustainable energy for displaced people. IMC provided robust, responsive and appropriate support to the programme partners for developing and delivering useful M&E to generate evidence and learning on what works in addressing refugee energy needs. The scope of this IMC-led M&E services comprises the design of the M&E framework, which included tools for programme management and an implementation plan.

For more information please contact Richard Edwards, our Senior Technical Director for MEL

E: Richard.Edwards@imcworldwide.comT: +44 (0)1737 231 400

FOLLOW US