1

Communication Outreach ReportEvaluation Conclave

2 3

Section I: Introduction

Partnerships and Sponsorshipsi. Speaker & Participants Profileii.

Section II: Keynote Addresses

Keynote Address by Abhijit Sen,Member Planning Commission of i. India

Keynote Address by Robert Chambers: Who Evaluation Should ii. Serve? Whose Voices Matter?

Keynote Panel: Making Evaluation Matter in Policy and iii. Programming in South Asia

Keynote Panel: State of Evaluation in South Asiaiv.

Section III: Plenary Addresses

Plenary Presentation: Multiple Voices, Multiple Perspectives from i. the Region: Building a Roadmap for Change

Plenary Address: IDRC 40th Anniversary and Conclave Plenary ii. Address: Evaluation, Governance and Social Accountability

Section IV: Breakout Sessions

Section V: Capacity Building Workshops

Section VI: Coffee Shop Meetings

Section VII: Voices Emerging from the Conclave

Section VIII: Evaluation of the Conclave

Contents

4 5

Real World Evaluation • Outcome Mapping: Evaluating Outcomes as Behaviour Change • Health Systems Evaluation • Evaluating Adaptive Responses to Climate Change• Enhancing Evaluation Use through Participation • Foundations of Evaluation: Theory, Design and Practice • Participatory Evaluation • Evaluating Networks • Evaluating Gender Transformative Projects and Programmes • Gender Evaluation Methodologies: Principles and Practice • Evaluation of Humanitarian Action with Yuka Hasegawa and John Cosgrave • Realist Synthesis •

Open Forums

A more informal space was provided at 14 coffee shop meetings where evaluators interested in a particular domain or set of questions came together to share ideas. A ‘host’ introduced members of the group and raised a set of questions and issues to explore.

Voices from the conclave

Deliberations during the four-day Conclave highlighted key issues relevant to the future development of evaluation particularly in the South Asian context. The role evaluation can play in enhancing accountability was highlighted in a number of sessions and with this in focus, there was a strong demand to increase the use of evaluation both at the government and user level. It was also felt that people should be central to the evaluation process – their participation should go beyond rhetoric, and they should be recognized as rights/claim holders rather than merely

beneficiaries.

The group felt that more work needs to go into improving the quality of evaluation in the region. Clearly there was also a requirement for professional capacity building on the subject along with evaluation field building. This would lead to a greater degree of professionalism and the emergence of evaluation as a discipline. There was a felt need to establish ethical standards for evaluators and evaluation frameworks, so as to standardise evaluation ethics and create a benchmark for quality.

Executive Summary

The first ever Global Evaluation Conclave ‘Making Evaluation Matter’ was held in New Delhi, India from October 25-28, 2010. It was envisaged that this Conclave would contribute to the emerging trend of viewing evaluation as a means to enhance development. In order to meet this need, the Conclave was designed to

provide stakeholders an opportunity to share experiences and knowledge, raise issues and determine ways to ensure that evaluation becomes more meaningful for development in South Asia.

Conceptualised by the Community of Evaluators (CoE) South Asia, the conclave was coordinated by the Association for Stimulating Knowledge (ASK) and Sambodhi Research and Communications with IDRC (International Development Research Centre) as a strategic partner and The IAMR (Institute of Applied Manpower Research) as joint organizers. The Conclave was methodologically neutral with multiple approaches and methods woven into the programme. This led to a unique format that of an eclectic mix of a series of plenary and panel sessions, workshop series as well as informal coffee shops. Three hundred evaluators from over 22 countries attended the Conclave.

The two keynote addresses were given by Abhijit Sen, Member Planning Commission of India and Robert Chambers, Institute of Development Studies, Sussex, UK. In his address, Sen provided a broad overview on the history and development of evaluation and set the Conclave in context. Speaking of the challenges faced in the practice of evaluation and the evidence-policy interface, Sen pointed out that there was a need for greater synergy between evaluators outside and within the government.

Chambers raised the crucial question: Who should evaluation serve? He underscored the need to include participatory methodologies in conventional evaluation processes.

The panels: ‘Making Evaluation Matter in Policy and Programming in South Asia’ and State of Evaluation in South Asia; highlighted perspectives, initiatives and elaborated on the practice of evaluation in the regional context.

Two plenary sessions on ‘Multiple Voices, Multiple Perspectives from the Region: Building a Roadmap for Change’ and ‘Evaluation, Governance and Social Accountability. The second plenary session was IDRCs 40th anniversary address.

Issues related to evaluation theory and practices in the regional context were deliberated in the break out sessions.

The 11 thematic breakout sessions addressed key issues such as:

Teaching Evaluation in South Asia (TESA): Professional Evaluation Solutions• Evaluation Capacity Development at the National Level: Approaches and Experiences• Impact Evaluation and Education in South Asia and China• Evaluation for Strengthened Health Systems and Outcomes• Using Evidence to Inform Development Policy • Integrating Gender and Human Rights in Evaluation • Evaluation Field Building: Models for Strengthening Capacity, Knowledge and Strutures in South Asia• Digital Storytelling for Gender Evaluation: Reflections from the Experience of the •

Association for Progressive CommunicationsPromoting Evaluation Use: Why Process Matters • Gender, Rights and Transformation: Building Bridges between Evaluation and Change • Donor Challenges in Evaluation•

In order to enhance the knowledge and skills of evaluators on emerging and sector specific evaluation methodologies, 13 capacity building workshops were held. Anchored by leading experts in the field, these were on:

Transformative Evaluation Mixed Methods •

Executive Summary

Prof.Abhijit Sen , Member Planning Commission

6 7

Contents

Section I: Introduction

Partnerships and Sponsorshipsi. Speaker & Participants Profileii.

Section II: Key Note Addresses

Keynote Address by Abhijit Sen, Planning Commission on Indiai. Keynote Address by Robert Chambers: Who Evaluation should serve? Whose voices ii.

matter?Keynote Panel on “Making Evaluation Matter in Policy and Programming in iii.

South Asia.”Keynote Panel: State of Evaluation in South Asiaiv.

Section III: Plenary Addresses

lenary Presentation: Multiple Voices, Multiple Perspectives from the Region: Building i. a Road Map for Change

Plenary Address: IDRC 40th Anniversary and Conclave Plenary Address: Evaluation, ii. Governance and Social Accountability

Section IV: Breakout Sessions

Section V: Capacity Building Workshops

Section VI: Coffee Shop Meetings

Section VII: Voices emerging from the Conclave

Section VIII: Evaluation of the Conclave

Section I: Introduction

8 9

Evaluation has contributed significantly to development processes, improving programmes and informing policy, but its use is limited to a small coterie of practitioners and, is unfortunately, separated from the implementation process. A new vision is emerging on how evaluation can serve development. The Evaluation Conclave 2010 — Making Evaluation Matter was designed to contribute to this vision.

Held in New Delhi, India, from October 25-28th, 2010, the attempt here was to provide sector experts, leading practitioners, thought leaders, representatives from governments, donors, multilateral development agencies, NGOs, academic and research institutions, evaluators and other influential stakeholders from across the globe, an opportunity to share their knowledge, raise issues, listen to one another and determine ways in which evaluation could be made more meaningful and useful for development in South Asia.

The Conclave was conceptualised by the CoE, a group of evaluators from South Asia working together to strengthen the field of evaluation in the region. ASK and Sambodhi (both CoE members) coordinated the event with IDRC as a strategic partner. The IAMR was also a joint organizer.

The design of the Conclave was kept methodologically neutral with multiple approaches and methods (impact evaluation, participatory evaluation, complexity thinking etc) being woven throughout the programme. This led to a unique, innovative design of an eclectic mix of a series of plenary, panel sessions, workshop series as well as informal coffee shops (Annexure I). Organizations also displayed evaluation resource and exhibits at the Conclave venue.

Introduction

1.1 Partnerships and Sponsorships

Partnerships and sponsorships were negotiated to help realize the Conclave. The reaction was overwhelming and an excellent mix of local and international organizations provided financial and/or in-kind support, and coordinated and hosted Conference sessions and strands.

Core Funders: Associate Funders: Partners:IDRC (International •

Development Research Centre), Canada

The Rockefeller Foundation•

The David and Lucile Packard • Foundation

United Nations Development • Fund for Women (UNIFEM)

UNICEF•

The Active Learning • Network for Accountability and Performance in Humanitarian Action(ALNAP)

3ie (International Initiative • for Impact Evaluation)

PACT•

International Organization • for Cooperation in Evaluation ( IOCE)

Sri Lanka Evaluation • Association (SLEvA)

1.2 Speaker and Participants’ Profile

The Conclave attracted global thinkers engaged in innovative evaluation research, theorizing, or practice who seek opportunities to push their thinking in new directions and are interested in applying their ideas in a South Asian context.

More than 300 evaluators from over 22 countries across the world registered and attended the Conclave (Annexure II). Of the total participants, the majority (63%) comprised of evaluators, followed by 28% of those who commission evaluation and 24% were researchers.

Introduction

10 11

Section II: Keynote Addresses

12 13

2.1 Keynote Address by Abhijit Sen, Member, Planning Commission, India

Prof Abhijit Sen, Member Planning Commission, India, delivered the keynote address on the first day of the Conclave. Reminding the audience that India had a long tradition of evaluation since the 1950s, he mentioned that Planning Commission members were aware of the need to suggest programmes with clear objectives and outputs to the Cabinet. He also highlighted the divide between the evaluators and the Programme Evaluation Unit (PEU) and mentioned that evaluation is perceived differently by the government and evaluators. While the government stresses on finding out whether the programme has delivered on its objectives and whether outputs have been achieved, evaluators question basic assumptions in the design

of the programme and suggest changes in the programmes themselves. This is not welcomed by programme designers who are usually senior government persons. Thus government focuses on monitoring programmes solely through outcome measurement rather than adopting a more holistic view.

Sen also pointed out that evaluators failed to enable government to take them seriously and demonstrate that theirs is a

professional discipline with standard curriculum and accepted protocols. The government is strong on statistics and sampling, but weak in drawing out inferences. Evaluators prefer to focus on people’s perceptions and participatory methods and this methodology is not taken well by government statisticians. He emphasised that the need of the hour is to change this approach and establish better synergies between independent evaluators and those of the government.

2.2 Keynote Address by Robert Chambers: Who Evaluation Should Serve? Whose Voices Matter?

In his thought-provoking address, Robert Chambers stressed on the significance of participatory methodology in the context of evaluation and raised four key questions:

• Does the evaluation empower poor beneficiaries?• Who participates in the evaluation process?• What do the poor learn from the evaluation?

Chambers warned of the dangers of donors and NGOs defining indicators without the input of partners/beneficiaries. He also emphasized the need for participatory indicators to evolve

Keynote Addresses

over time. Going further, he said: “If a programme begets the same indicators over time, then something is very wrong”. His message to the audience at the end of his address was: “Go to the people! Build with what the people have!”

2.3 Keynote Panel: Making Evaluation Matter in Policy and Programming in South Asia

This keynote panel discussion was chaired by Santosh Mehrotra, Institute of Applied Manpower Reasearch (IAMR) India. The panellists were from South Asia: V.V. Sivagnanasothy (Ministry of Traditional Industries and Small Enterprises Development, Sri Lanka), Mohammad Ismail Rahimi (Ministry of Economy, Govt of Afghanistan) and Rajeev Mehta (National Sample Survey Organisation – NSSO, India).

This key session focused on ‘Who Evaluation Should Serve and How’. Each panellist presented and shared their country experiences and perspectives. The session sought experiences and responses from the governments in South Asia region on how evaluation is placed and prioritised policy, strategy and governance. The three speakers from the three South Asian Countries shared specific evaluation strategies, initiatives and outcomes in their countries highlighting improvement in processes, results and impact. Highlighting the demand of evaluation from different quarters (government, donors, non-government agencies etc.) the speakers elaborated on country-level efforts being made and the space being given to evaluation in the programmes and activities of the non-government and private sectors.

2.4 Keynote Panel: State of Evaluation in South Asia

This panel was chaired by R.S. Goyal Institute of Health Managment Research (IIHMR) India and comprised four panellists namely Anwar Jabarkhail, MD, CEO of Ibn Sina (Afghanistan), Mallika Samaranayake Founder Director/Chairperson of the Institute for Participatory Interaction in Development (IPID), Sri Lanka, Milindo Chakrabarti, Executive Director of Development Evaluation Society of India (DESI) and Raju Joshi, Director Policy & Programme Division, Social Welfare Council (SWC) of Nepal.

This panel was designed to hear about experiences from countries in South Asia in the context of how evaluation is being practiced in terms of policies, strategies and the space that is given to evaluation in governance. Each speakers highlighted the extent to which the evaluation field is being built in terms of its usage in development programmes and governance.

Keynote Addresses

14 15

Section III: Plenary Addresses

16 17

3.1 Plenary Presentation: Multiple Voices, Multiple Perspectives from the Region: Building a Roadmap for Change

There was a need to integrate different viewpoints across South Asia for the CoE in order to build the roadmap for the future. This session focused on the discussions that had taken place in previous regional meetings in Kathmandu, Mumbai, Chennai and Dhaka. These events explored the challenges, gaps and opportunities in making evaluation matter in development and ways to connect evaluators, evaluation commissioners and evaluates at the national, state and grassroots level. These sessions were attended by 200 evaluators, funders, policy makers and development implementers in the three countries (Nepal, India and Bangladesh).

Key insights and highlights of discussions were presented. Speakers raised the major challenges for evaluation community in South Asia and voiced the need for major stakeholders (namely beneficiaries, governments, implementers, funders, evaluators) to nurture ‘collective ownership over the evaluation’. Additionally, affirm benefits of evaluation use for transparency, accountability, better development and good governance. The presentation also stressed on the need for wider dissemination and opportunities to replicate evaluation findings in the regions.

3.2 Plenary Address: IDRC 40th Anniversary and Conclave Plenary Address: Evaluation, Governance and Social Accountability

This panel, chaired by Stephen McGurk (IDRC, India) explored the intersecting work of strengthening state governance, evaluation and accountability mechanisms and work on designing and implementing effective voice and accountability interventions. Central and local government institutions are often indifferent to the needs of the poor and marginalized and show little accountability to them. Much attention has been placed on strengthening evaluation and accountability methods and structures focussed on the State, but there have been inadequate gains in building the structures and capacity of ordinary citizens to engage in evaluation processes of policies and programmes that affect their lives. The panellists explored the changing context of ‘evaluation for accountability’ work in South Asia, tools for citizen engagement and innovations in measurement and evaluation. Drawing on work in India and Bangladesh, the panellists explored the existing and potential role of evaluation in deepening the democracy and rights framework and power representation in the region. McGurk connected work in evaluation research and the evaluation field building to research, policy, and programming in South Asia and raising questions on how it all can be deepened and strengthened in ways that support more evidence based and inclusive development.

Raghavan Suresh from the Public Affairs Centre in Bangalore explored connections and innovations in the evaluation of public policies and citizen participation in governance and public life in India. Drawing on recent work by the Institute of Governance Studies in Bangladesh, Gopakumar Kumar Krishnan explored the role of evaluation in promoting more democratic governance and deeper and more meaningful social accountability.

Plenary Addresses Plenary Addresses

Section IV: Breakout Sessions

18 19

Breakout Session 1: Teaching Evaluation in South Asia (TESA): Professional Evaluation Solutions

This panel provided an intellectual and experiential exchange space for promoting professionalization in evaluation. Here TESA (Teaching Evaluation in South Asia) members shared the mission, strategy and approaches. As a sustainable strategy for professionalizing evaluation in South Asia, a consortium of academic institutions will institutionalise evaluation training at postgraduate level in South Asia. The consortium will develop a curriculum for a post graduate diploma in evaluation and members will individually move forward to create a facilitative environment to teach evaluation. The panel shared that TESA is open for membership by other academic institutions. The curriculum and other pedagogical materials developed in TESA will be made available to other institutions that wish to promote evaluation training.

Breakout Session 2: Evaluation Capacity Development at the National Level: Approaches and Experiences

This panel generated a dialogue on approaches and experiences related to national evaluation capacity development. As it is widely recognized, international development is evolving from aid-driven development to country-led initiatives acknowledging that national ownership and leadership are core to development. Although there has been progress and good practices exist, several challenges remain. The discussion highlighted the relevance of strategies aimed at developing or enhancing country-led M&E systems. The panel focused on country

Breakout Sessions

experiences on practices that have worked and lessons that can inform the way forward.

Breakout Session 3: Impact Evaluation and Education in South Asia and China

This session explored the rigorous evaluation methodologies to measure the impact of education interventions. There was discussion on how impact evaluations can be used as a policy tool which can help in establishing the causal impact of a project or a policy initiative on critical educational outcome indicators (e.g., educational enrollment, standardized test scores, etc). During the discussions, panelists appreciated techniques such as randomization control trials, difference-in-difference and propensity score matching and panel data fixed effects estimators.

Breakout Session 4: Evaluation for Strengthened Health Systems and Outcomes

This panel explored the role of evaluations in strengthening health systems. The panel helped develop a research agenda for the evaluation of health systems in South Asia and explored questions such as:

What kind of evaluation capacities need to be developed to conduct research and • evaluation into health systems?

What kind of evidence is needed for strengthening health systems?• Are there success stories in South Asia in which specific evaluations have played a •

role in strengthening health systems?What types of evidence do policy makers and practitioners need to make decisions •

about health systems transformations?Is the knowledge of the need for such evidence based on actual practice? How can •

evaluations help generate such evidence?Is there evidence that specific evaluations have helped improve the quality of health •

systems?

Breakout Session 5: Using Evidence to Inform Development Policy

This panel discussed key aspects on the design of quality impact evaluations and how they best influenced policy. Impact evaluations form the basis for evidence-based policy making. But simply undertaking studies does not produce policy impact. There are aspects of study design, implementation and dissemination, which can serve to increase the chances that a particular study will be influential.

Breakout Session 6: Integrating Gender and Human Rights in Evaluation

The panel opened the debate on opportunities and challenges related to the integration of gender and human rights in evaluation in the context of international development. The United Nations is founded on the principles of peace, justice, freedom and human rights. Integration of gender equality and human rights has always been at the heart of all UN initiatives. However, the meta-evaluations regularly conducted by UN agencies and studies suggest that attention

Breakout Sessions

20 21

to human rights and gender equality requires considerable strengthening in programming as well as in evaluation. Drawing on practical examples of UN evaluations, each speaker explored the principles and methodologies deployed in the evaluation of gender and human rights in both gender and human rights specific and non-specific programmes.

Breakout Session 7: Evaluation Field Building: Models for Strengthening Capacity, Knowledge and Structures in South Asia

This panel highlighted experiments in South Asia in the field of evaluation. The panel started from the understanding of a field as an area of specialized practice carried out by trained practitioners and explored key elements of field building including supporting capacity strengthening and emerging leaders, fostering information exchange and collaboration and generating evaluation knowledge.

During the panel discussion, speakers provided cases to demonstrate and articulate what is needed and being done in field building and explored interconnections between different efforts.

Field building was discussed through the exploration of a set of ongoing efforts including:An effort to build structures for long term training through a post-graduate diploma in •

evaluation in universities in Bangladesh, India, Pakistan and Sri Lanka An initiative to bring evaluators in South Asia together to strengthen practice, engage •

in peer learning and support and share knowledge. This will be called the Community of Evaluators

The use of knowledge and learning spaces like the Evaluation Conclave• Building capacity by doing evaluation based on the experiences of India’s National •

Council for Educational Research and TrainingUN efforts to build norms and standards in Evaluation• The World Bank, IEG work to support a Centre for Evaluation•

Breakout Session 8: Digital Storytelling for Gender Evaluation: Reflections from the Experience of the Association for Progressive Communications

The panel explored the ways in which digital storytelling can add value to the evaluation exercise. Thes are case studies produced, stored and disseminated using digital media. Digital story-telling, as a recording and documentation method foregrounds the voice and experiences of story tellers as primary in the process of story-telling.

The focus is on the story tellers’ control over the medium, choice of words (narration), pictures and music so that the process is as powerful for the story teller as the end product is to the listener. APC’s Women’s Networking Support Programme (WNSP) explored the use of digital storytelling as a complement to its Gender Evaluation Methodology (GEM) to narrate a change story related to evaluation and gender transformative change, with the story teller as the witness or the one who experienced this change.

Breakout Sessions

Breakout Session 9: Promoting Evaluation Use: Why Process Matters

This panel introduced a 12-step Use Focused Evaluation (UFE) process designed to facilitate its incorporation in strategic and operational aspects of a programme’s development. It also presented learnings from the application of this UFE approach in ICT4D research and policy networks in Asia.

Breakout Session 10: Gender, Rights and Transformation: Building Bridges Between Evaluation and Change

The panel highlighted ideas on moving this work forward in the region. Participants were encouraged to join and share ideas on collaboration and moving forward. The practice of evaluating women’s empowerment programmes or the ‘gender’ component in development has expanded in recent years in South Asia, making it important to document and theorize on gender, development and evaluation. Drawing on several cases, the panel critically examined the theories influencing and the methods being used to evaluate gender and development in South Asia. Asking, “Whose questions matter?” the panel explored how evaluation is being, and should be used to affect real change.

Breakout Session 11: Donor Challenges in Evaluation

This panel discussed challenges brought forward by evaluation exercises that are faced by recipients of funds from donors and also by donor agencies. Evaluation units have to respond to requests from their managers and Boards to provide insights into the impact of agency funding - even when impacts are hard to measure and even harder to attribute to donor funding. Evaluation units must also consider impact in the aggregate: What do all the projects add up to in terms of donor strategy or programme mission? Panel members addressed the challenges they face in addressing, in dealing with the challenge of project versus system evaluation.

Breakout Sessions

22 23

Section V: Capacity Building Workshops

24 25

Workshop 1: Transformative Evaluation: Mixed Methods with Donna Martens

Transformative Evaluation is an approach that focuses specifically on contexts that recognize the need to explicitly address issues of social justice and power inequities if we are to contribute to social transformation. Evaluators work in challenging contexts often with people who have not had full access to their basic human rights. The workshop provided a framework for evaluators based on a set of philosophical beliefs that concern ethics, power relations, the role of the evaluator in social change and methodologies that support the pursuit of social justice. Implications of these philosophical beliefs were illustrated through the use of examples of evaluations from multiples sectors.

Workshop 2: Real World Evaluation with Jim Rugh and Soma de Silva

This workshop presented a seven-step process; a checklist and a toolbox of techniques that will help evaluators and ensure clients the best quality evaluation under real-life constraints. The workshop also introduced the real world evaluation approach and its practical utility was assessed through presentations and examples from international experiences and small-group exercises.

Workshop 3: Outcome Mapping: Evaluating Outcomes as Behaviour Change with Raj Verma and Sarah Earl

Outcome Mapping (OM) is an approach for planning, monitoring and evaluating social change initiatives. This workshop provided a broad overview of the main principles underpinning outcome mapping and introduced participants to the central concepts for planning and evaluating outcomes. It also shared ways to learn more about outcome mapping and its application.

Workshop 4: Health Systems Evaluation with Sanjeev Sridharan and Abhijeet Das

This workshop explored the challenges of evaluating health systems and also useful evaluation approaches that can help in health system transformations. It also examined the advantages of using a complex systems perspective to evaluate health system reform efforts.

Workshop 5: Evaluating Adaptive Responses to Climate Change with Kurt MacCleod and Ana Coghlan

The two-day interactive workshop focused on the major dimensions, challenges and innovations

Capacity Building Workshops

in evaluating adaptive responses to climate change. It was aimed at evaluation practitioners, policy makers, commissioners and funders. They discussed, examined and debated on challenges posed by climate change adaptation to the field of development evaluation. They also looked at stakeholder involvements in climate change, mitigation including issues of scale, timeframe and systems associated with innovations, gaps and implications for development evaluative practice, methods, tools, standards and evaluation governance; paths to strengthen evaluation purpose and practice with respective of society and systems. This workshop was part of a larger ongoing initiative supported by the Rockefeller Foundation, to build a community of practice of evaluators working with climate change adaptation in South and South East Asia.

Workshop 6: Enhancing Evaluation Use through Participation with J. Bradley Cousins and Peer Assisted by Sonal Zaveri

This workshop focused on Practical Participatory Evaluation (P-PE). Participatory evaluation is conducted in partnership with those trained in evaluation methods logic and stakeholders who are non-evaluators. The approach is often used as leverage for social change through building skills, raising awareness and fostering self-determination. Gaining knowledge and understanding of evaluation use, including distinctions between ‘use of findings’ and ‘process use’, the participants appreciated the differential

contribution of evaluators and programme community members to the P-PE process. Value was also found in the organizational use of evaluation as a learning system and there was an exploration of practical strategies to design and implement P-PE.

Workshop 7: Foundations of Evaluation: Theory, Design and Practice with Chris L. S. Coryn and Peer Assisted by Shubh Kumar Range

In this course, participants were introduced to a variety of antecedent and contemporary evaluation theories, models, their approaches and ideological underpinnings. The workshop began with important foundational and conceptual information about evaluation (general vocabulary, purposes, uses) followed by in-depth analysis of a wide variety of evaluation theories, models, approaches, including their central characteristics and examples of their application in practice.

Workshop 7: Participatory Evaluation with Robert Chambers, Mallika Samaranyeke and Sonal Zaveri

Participatory evaluation has been a topic of great interest in the development arena for quite some time because of its challenging nature of enlisting participation of all stakeholders. It is considered a basic requirement to understand the conceptual background that drives the process and practice.

Capacity Building Workshops

26 27

This workshop aimed to engage the participants in a comparative analysis of participatory and conventional evaluation, addressing ‘who and whose’ questions. Sessions also addressed ’Quantifying the Qualitative’”, focusing on approaches and challenges of quantifying participatory evaluation results.

Workshop 8: Evaluating Networks with Sanjeev Khagram and Catrina Lucero with Peer Assistance by Vinita Tatke

This workshop provided a conceptual overview of networks, the current field of network evaluation and the specific evaluation challenges faced here. Networks have been championed as powerful mechanisms for rapid growth and diffusion, adaptive and connective capacity, resilience and ultimately impact. Yet, still relatively little of the network ‘advantage’ has been tested and the assessment of network effectiveness remains underdeveloped. Networks and networked initiatives must learn to operate efficiently and effectively in a world of constrained resources and demands for accountability. This requires the development of new systems for impact planning, assessment, reporting and learning (IPARL). Session leads introduced the IPARL approach that they have developed as a functional set of tools for evaluation practitioners.

Workshop 9: Evaluating Gender Transformative Projects and Programmes with Ratna Sudarshan and Kameshwari Jandhyala

The workshop started with an initial discussion on the context and aspirations of gender transformative projects and programmers in India and the use of innovative methodologies in sectors such as education, health and livelihoods. The workshop then focused on the ways in which issues around gendered impact can be highlighted through evaluation; reviewing the experiences with impact and outcomes of evaluation, possible ways ahead to strengthen the culture of evaluation and receptivity to post evaluation re-design of projects and programmes that seek gender transformation.

Workshop 10: Gender Evaluation Methodologies Principles and Practice with Anupama Saxena and Angela M. Kuga Thas.

The Gender Evaluation Methodology (GEM) developed by the Association for Progressive Communications (APC) within its Women’s Networking Support Programme (WNSP) is an evaluation methodology initiated, developed, deployed and promoted entirely by women primarily from the Global South. In some circles, the view still remains that the design of ICT for Development (ICTD) projects is a technical matter and that technology itself is gender neutral. GEM has successfully challenged these notions in the planning, evaluation and re-designing of ICTD-type projects. Significant

Capacity Building Workshops

differences in local contexts (including the level of economic development and differing gender roles) mean that the major issues that affect women’s relationship to technology varies from community to community. GEM was designed to be sufficiently flexible to accommodate these very important contextual differences from the perspective of gender equality and women’s empowerment.

Workshop 11: Evaluation of Humanitarian Action with Yuka Hasegawa and John Cosgrave

This workshop primarily focused to draw on the work of ALNAP, a unique sector-wide network for performance learning and accountability in the humanitarian realm. The workshop introduced participants to the key issues and challenges of evaluating humanitarian action. The three sessions covered different aspects of evaluating humanitarian responses, from evaluation criteria, to tools and techniques, through evaluation utilization and case studies, including evaluation of Tsunami and Haiti response. The session also included sharing ALNAP’s ongoing research and training work on evaluations.

Workshop 12: Realist Synthesis with Ray Pawson

This session focused on the gaps of real time evaluations and the need for a new approach incorporating all the aspects of policy and planning. This is primarily because the policy cycle revolves quicker than the research cycle, as a result of which, real time evaluations often have little influence on policy development. The quest for evidence-based policy has, thus, turned increasingly towards systematic reviews of existing inquiries in the relevant policy domain. This workshop therefore focused on the following aspects: ‘Why Turn to Review and Synthesis?’, ‘Programme’s Complexity and the Review Swamp’, ‘The Review Template – Steps in Realist Synthesis’, ‘Examples of Realist Synthesis (each with a review dilemma)’.

Workshop 13: The Use of Appreciative Inquiry (AI) in Evaluation with Ana Coghlan with Peer Assistance by Gana Pati Ojha

This workshop explored the ways in which Appreciative Inquiry can be used for evaluation purposes. Appreciative Inquiry (AI) is a relatively new and radically different approach and methodology from the field of organizational development that inquires into and discovers the ‘best of what is’ in organizations and programmes. Participants were introduced to the theoretical underpinnings of AI and then AI exercises were conducted. By applying this experience, participants explored the advantages and disadvantages of using AI in evaluation, the appropriate evaluation contexts for using AI and specific applications of AI in particular evaluation.

Capacity Building Workshops

28 29

Section VI: Coffee Shop Meetings

30 31

These meetings were planned as an informal space for evaluators interested in a particular domain or set of questions to come together, meet and share ideas. They were led by a ‘host’ who introduced the group to each other and raised a set of questions and issues to explore.

The details of coffee shops are enumerated in table below:

Table 1: Details of Coffee Shop MeetingsSl.No Meeting Particulars Hosts1. Evaluating Sensitive Issues:

Methodological Issues (using a case study of Violence Against Women)

UNIFEM

2. Evaluation of Transformative and Feminist Evaluation

Donna Martens (Gallaudet University, USA) and Veronica Magar (REACH)

3. Strength Based Evaluation Gana Pati Ojha (CoE member, Nepal)4. Evaluation in the Education

SectorJ. Bradley Cousins (University of Ottawa, Canada), Vasant D. Bhat (NCERT India), Undurthy Lakshminarayana (NCERT India), Manju Jain, (NCERT India), Sandhya Paranjpe (NCERT India), Kiran Devender (NCERT India), Poonam Bhambri (NCERT India)

5. Role of Evaluation in Conflict Setting

A.Ghani (CoE member, Afghanistan) and Colleen Duggan (IDRC,Canada)

6. Evaluation Associations and Networks

Jim Rugh (Independent Consultant) and Mallika Samaranayake (SLEvA and member CoE)

7. Evaluation at the Grassroots Bhabatosh Nath (RIDS, Bangladesh), Khairul Islam(CoE member Bangladesh) and Pramel Gupta (CoE member, India)

8. Evaluation Curriculum and Capacity Building

Soma De Silva (SLEvA, Sri Lanka)

9. Evaluation with Children: Challenges, Ethics and Innovations.

Sonal Zaveri (Child-to-Child Trust and CoE member, India) and Nazmul Kalimullah (U&I, University of Dhaka, Bangladesh)

10. Evaluating Policy Research Challenges and Opportunities

Peter Taylor (IDRC, Canada) and Samar Verma (IDRC, India)

11. Evaluating Campaigns: Experience Sharing

Paramita Dasgupta (CMS, India) and Anuradha Rajan (Oxfam GB)

12. Ethics in Evaluation Vinita Tatke, CoE member13. Evaluation of Agriculture, Food

Security and Natural Resource Management Programmes

Veena Khanduri (ISID, India)and Gana Pati Ohja (CoE member, Nepal)

14. Evaluation for Social Accountability

Ravinder Kumar (CMS)

Launch of the Community of Evaluators and Call for Members

The Conclave concluded with the formal launch of the Community of Evaluators (CoE) in South Asia. CoE Member Ms. Vinita Tatke formally announced the launch of the CoE and invited membership to the community.

Coffee Shop Meetings Coffee Shop Meetings

Section VII: Voices Emerging from the Conclave

32 33

A review of the rich and intense deliberations and discussions that ensued during the course of the four-day Conclave highlighted some key issues relevant to the future development of evaluation particularly in the context of South Asia. There was a common agreement among the participants that as there is a tremendous need to do more evaluations, there is also a need to encourage that the findings of evaluations are shared widely, discussed and finally incorporated in designing and implementing programmes.

Evaluation for Enhancing Accountability

The role of evaluation in enhancing accountability was highlighted and reiterated in a number of sessions. The need for National Policies on Evaluation and their proper implementation (identifying gaps in policy and implementation in countries that have the policy) was re-emphasized and univocally voiced by various speakers.

In this regard, there was also a strong demand to increase the use of evaluation to enhance accountability both at the level of governments and users.

The role of evaluation in influencing policy, programmes schemes (evidence-based decision making) was also stressed upon. Lastly, the need to engage with the public sector was also strongly voiced.

People Must Come First

It was also emphasized that people, the most important stakeholders, should matter more in evaluation – their participation should go beyond rhetoric and that they are to be recognized as rights/claim holders rather than merely beneficiaries. The need for partnership with the community and heightened accountability towards them was also emphasized in the Conclave. It was also reiterated that Community should not be taken as homogeneous rather the diversity needs to be understood and gender, amongst other aspects needs to be analyzed systematically.

Culture, Ethics and Standards

In order to improve the quality of evaluation at large and particularly in the region, the need for establishing ethical standards for evaluators and evaluation frameworks, which standardize the evaluation ethics and creates benchmark of quality evaluations, was also, felt. Guidelines need to be developed for the evaluation processes so that ethics and standards are enhanced and evaluators maintain both their independence and rigour.

Improving the Quality of Practice

The group agreed that more work needs to be undertaken on improving the quality of evaluation in the region. In this regard, need for professional capacity building on evaluation (Quality of Practice) was emphasized. It was also emphasized that field-building in evaluation needs to go beyond the limited perspective of capacity building – leading to professionalism and developing evaluation as a discipline in the long run.

Voices Emerging from the Conclave Voices emerging from the Conclave

Section VIII: Evaluation of the Conclave

34 35

CoE organised an evaluation of the Evaluation Conclave through distribution of evaluation forms among participants. Two set of evaluation forms were shared:

Overall Conclave Feedback Forms: These forms sought feedback on the design, quality and administration of the Conclave. A total of 107 conclave attendees responded to the Overall Conclave Feedback Form.

Workshop Feedback Forms: These forms given at the end of each of the training workshops sought feedback on the workshop and workshop leaders. A total of 165 participants responded to the workshop forms.

The forms yielded very valuable feedback as well as information for future planning. The results of the conclave evaluation are presented below:

Overall Impression of Conclave: Of the 107 attendees who responded to the Overall Conclave Forms, the majority rated the conclave as very good (49%) or good (40%) and excellent (10%) whereas the remaining rated it as marginally good (2%). None of the participants rated the Conclave poorly. (Figure A)

Figure A:

Quality of Conclave: In terms of quality as well, the Conclave was rated highly by the respondents on the following parameters:

a. Level of Participation: 64% of the respondents rated the level of participation as ‘good’ in the Conclave while 31% rated the participation as ‘excellent’ and the remaining rated it ‘fair’. None of the respondents commented poorly on level of participation.

b. Facilitators Involved: Likewise 68% of the 107 respondents rated the facilitators as ‘good’, 26% rated them as ‘excellent’ and the remaining rated them as ‘fair’ (6%).

c. Contents covered: In terms of content, the Conclave was rated highly. 67% of the respondents rated it as ‘good’, 17% as ‘excellent’ and the remaining as ‘fair’.

Evaluation of the Conclave

d. Event Organization was rated as ‘excellent’ by 33% of the 107 respondents and ‘good’ by 54%.

Usefulness of the Conclave: Views were also sought of the Conclave participants on the usefulness and utility of the Conclave for them on a range of parameters. Amongst others, it was encouraging to note that 49% of the participants confirmed that they would become more active in promoting the use and culture of Evaluation in South Asia followed by 34% participants who were “almost sure” of this.

Second, the participants also valued the usefulness of the Conclave as a networking opportunity wherein they forged new contacts. Almost 83% of the participants shared that they would utilize the new contacts that they made during the Conclave.

Third, 80% of the participants also appreciated the fact that they have a deeper or broader understanding of the issues as a result of the Conclave whereas 56% attributed a change in their attitude towards evaluation to the Conclave. (See Table 2)

Table 2: Feedback received from Participants on Usefulness of the Conclave

Future CoE Events: In the Overall Feedback form, feedback was also sought from respondents on future CoE events. It was extremely encouraging to note that there was an overwhelming yes from all 107 respondents on continuance of Conclave series in future.

In this regard, 60% felt that the Conclave should be made an annual event; the remaining said it should be organized bi-annually.

It was good to note that 80% of the respondents confirmed that if such an event is organized in future, they would attend it. The rest did not say ‘no’ to this probability.

Lastly, on the question of willingness to pay, 23% of the respondents expressed their willing to pay to attend the Conclave while 60% expressed it as ‘may be.’

The Conclave has also been highlighted for its usefulness with comments focussing on:

• the high quality of the workshops in terms of presentation and content (supported by the excellent evaluation results of the 14 workshops for which forms are available)

Evaluation of the Conclave

36 37

Evaluation of the Conclave

• the ample opportunities provided to interact and network

• the appropriate format and high quality and relevance of the Conclave programme; the large number and diversity of the participants

• the high quality of a number of presentations as well as the high quality of floor discussions and the effective organisation of the Conclave

ANNEXURE I

38 39

ANNEXURE I ANNEXURE I

08:00 AM - 09:30 AM

Time Day - 1 Agenda : 25th October, 2010

09:30 AM - 10:45 AM

10:45 AM - 11:30 AM

11:30 AM – 01:00 PM

01:00 PM - 02:00 PM

02:00 PM - 04:00 PM

Registration opens

Inauguration Session

Welcome - Prof. R.S. Goyal (IIHMR and CoE Member, India)

Introducing the Community of Evaluators (CoE) - Shubh Kumar Range (CoE member, India)

Objectives of the Conclave - Kultar Singh (Sambodhi, CoE member India)

Introduction of keynote speaker - Rashmi Agarwal (IAMR and CoE Member, India) Keynote address - Abhijit Sen (Planning Commission, India)

The role of Evaluation in Policy and Programming

Vote of thanks by - Khilesh Chaturvedi (Association for Stimulating Know How and CoE member, India)

Tea Break

Keynote Panel Challenges and Opportunities of Evaluation by the Indian Planning Commission

Chair - Prof. Vijay Vyas Panelists - Dr.Santosh Mehotra - Dr. Jagdish Pokharel (Planning Commission, Nepal) - Other South Asian panelists TBC

Lunch Break

Workshop Series 1 1. Transformative Evaluation Mixed Methods

Workshop Leader - Donna Mertens (Gallaudet University, USA) Peer Assist - Chelladurai Solomon (CoE member, India)

2. Real World Evaluation

Workshop Leaders - Jim Rugh (Independent Consultant) - Soma De Silva (SLEvA, Sri Lanka)Peer Assists - Ramesh Tuladhar ( CoE member, Nepal) - Ram Chandra Khanal ( CoE member , Nepal)

3. Outcome Mapping: Evaluating Outcomes as Behaviour Change

Workshop Leaders - Raj Verma (NEPED, India) - Sarah Earl (IDRC, Canada)

4. Health Systems Evaluation

Workshop Leaders

Tea break04:00 PM – 04:30 PM

04:30 PM - 06:00 PM

06:30 PM - 07:30 PM

Time Day - 1 Agenda : 25th October, 2010

- Sanjeev Sridharan (University of Toronto , Canada) - Abhijit Das (CHSJ, India)

5.Evaluating Adaptive Responses to Climate Change Workshop Leaders - Kurt MacLeod (PACT) - Ana Coghlan (PACT) - Stefan Nachuck (Rockefeller Foundation) - Md. Hamidur Rahman (PRIP Trust, Bangladesh) - Benjamin Sovacool (NUS) - Sreeja Nair (TERI) - Sabita Thapa (SEI) - Sara Ahmed (IDRC, Canada) - Broan Lund (Oxfam, America)

6. Enhancing Evaluation Use through Participation Workshop Leader - J. Bradley Cousins (University of Ottawa, Canada) Peer Assist - Sonal Zaveri ( Child-to-Child Trust and CoE member, India)

7. Foundations of Evaluation: Theory, Design & Practice

Workshop Leader - Chris L. S. Coryn (EC and Western Michigan University, USA) Peer Assist - Shubh Kumar Range (CoE member, India)

Workshop Series 1 Continued

Reception Dinner

09:00 AM - 09:45 AM

09:45 AM - 11:15 AM

Time Day - 2 Agenda : 26th October, 2010

Keynote address: Who should evaluation serve? Whose voices matter?

Panelist - Robert Chambers Introduction by - Sonal Zaveri (Child-to-Child Trust and CoE member, India)

Keynote panel: State of Evaluation in South Asia Chair - R.S. Goyal (IIHMR and CoE member, India) Panelists - Milindo Chakrabarti (DESI and CoE member India) - Mallika Samaranayake (SLEvA and member CoE, Sri Lanka) - Jabarkhail Anwarulhuq (IbnSina, Afghanistan) - Raju Joshi (SWC,Nepal)

11:15 AM - 11:30 AM Tea break

11:30 AM - 01:00 PM New Directions in Evaluation Series 1 (Break-out sessions):

1. Evaluation and Climate Change Adaptation: New Directions and Approaches

Workshop Leaders - Nancy MacPherson (The Rockefeller Foundation, United States) - Sara Ahmed (IDRC, India)

Time Day - 2 Agenda : 26th October, 2010

40 41

ANNEXURE I ANNEXURE I

2. Teaching Evaluation in South Asia: Professional Evaluation Solutions

Workshop Leaders - Soma De Silva (SLEvA, Sri Lanka) - George. F. Grob (Center for Public Program Evaluation) - Kumudu Wijewardena (University of Sri Jayawardenepura, Sri Lanka) - Anand Akundy (Administrative Staff College of India) - Zulaikha Haq (IbnSina, Afghanistan) - G.M. Chowdhury (University of Dhaka, Bangladesh)

3. Evaluation Capacity Development at the national level: approaches and experiences

Chair - Ada Ocampo (Unicef, Thailand)Panelists - Marco Segone (Unicef, United States) - A.K. Shiva Kumar (Unicef Consultant, India) - Arunaselam Pasappan (Malaysia) - Joaquín González- Aleman (Unicef, India)

4. Impact Evaluations and Education in South Asia and China

Chair - Swapnil Shekhar (Sambodhi,India)Panelists - Geeta Gandhi Kingdon (University of London, UK) - A.B.L Srivastava (EDCI, India), Colin Bangay(DFID, India) - Colin Bangay(DFID, India)

Time Day - 2 Agenda : 26th October, 2010

11:30 AM - 01:00 PM

Lunch Break01:00 PM - 02:00 PM

02:00 PM - 04:30 PM

04:30 PM - 05:00 PM

Workshop Series 1 ends

Tea break

05:00 PM - 06:00 PM Coffee Shop Meetings

1.Evaluating Sensitive Issues: Methodological Issues (using a case study of Violence Against Women)

Hosts - Unifem

2.Evaluation of Transformative and Feminist Evaluation.

Hosts - Donna Mertens (Gallaudet University, USA) and Veronica Magar (REACH)

3.Strength based Evaluation Hosts - Gana Pati Ojha (CoE member, Nepal)

4.Evaluation in the Education Sector.

Hosts - J. Bradley Cousins (University of Ottawa, Canada) - Vasant D. Bhat (NCERT India) - Undurthy Lakshminarayana (NCERT India) - Manju Jain, (NCERT India) Dr. Sandya Paranjpe - (NCERT India), Dr. Kiran Devender (NCERT India) - Poonam Bhambri (NCERT India)

5.Role of Evaluation in Conflict SettingHosts - A.Ghani (CoE member, Afghanistan) - Colleen Duggan (IDRC,Canada)

6.Evaluation Associations and Networks

Hosts - Jim Rugh (Independent Consultant) - Mallika Samaranayake (SLEvA and member CoE, Sri Lanka)

7.Evaluation at the grassroots

Hosts - Bhabatosh Nath (RIDS, Bangladesh) - Khairul Islam(CoE member Bangladesh) - Pramel Gupta (CoE member,India)

Time Day - 2 Agenda : 26th October, 2010

Time Day - 3 Agenda : 27th October, 2010

9:00 AM – 10:00 AM

10:00 AM - 11:30 AM

Plenary Presentation: Multiple Voices, Multiple Perspectives from the Region Building a Roadmap for Change

Hosts - Chelladurai Solomon (Independent consultant and CoE member India) - Sonal Zaveri (Child-to-Child Trust and CoE member, India) - Ramesh Tuladhar ( CoE member Nepal ) - Bhabatosh Nath (RIDS and CoE member Bangladesh)

New Directions in Evaluation Series 2 (Break-out sessions)

1. Evaluation for Strengthened Health Systems and Outcomes

Chair - Sanjeev Sridharan (University of Toronto, Canada)Panelists - Suneeta Singh (Amaltas, India) - A.K.Shiva Kumar (Unicef, India) - Stefan Nachuk (Rockefeller Foundation) - Lester Countinho (Packard Foundation, India)

2. Using evidence to inform development policy

- Anand Gupta - Santosh Mehrotra (IAMR, India) - N Raghunathan (CMS, India)

3. Integrating Gender in Evaluation - UN agency panel coordinated by UNIFEM

Panels of selected paper 4. Assessing Climate Change Interventions

Chair - Narendra Singru (Asian Development Bank, Philippines.)Panelists - Rema Saraswathy (Institute of Sustainable Development,India) - Jyotsna Bapat (Independent Consultant, India) - Jyotsna Silting (Independent Consultant , India)

5. Strengthening Communication Interventions through Evaluation

Chair - P.N. Vasanti ( Centre for Media Studies, India)Panelists - Niamh Brannigan (Global e-Schools and Communities Initiative)

42 43

- Lalitendu Jagatdeb (Population Foundation, India) - Mamta Baxi (Cosmo Foundation, India) - Joseph Fredrick (World Vision, India)

6. Using Evaluation to Strengthening Education and Learning programs

Chair: - Jayshree Oza ( NCERT, India)Panelists - Alison Barrett (British Council, India) - B.N.Panda (NCERT) - U. Laxmi Narayana (NCERT, India)

Time Day - 3 Agenda : 27h October, 2010

11:30 AM - 11:45 AM

11:45 AM - 01:00 PM

Tea Break

Workshop Series 2

1. Participatory Evaluation

Workshop Leaders - Robert Chambers - Mallika Samaranayake ( SLEvA and member CoE, Sri Lanka) - Sonal Zaveri ( Child-to-Child Trust and CoE member, India) 2. Evaluating Networks

Workshop Leaders - Sanjeev Khagram (iScale) - Catrina Lucero (iScale)Peer Assist - Vinita Tatke (CoE member, India)

3. Theory Based Impact Evaluation

Workshop Leaders - Yuka Hasegawa (ALNAP, United Kingdom) - John Cosgrave (ALNAP, United Kingdom)

4. Evaluating Gender Transformative Projects and Programs

Workshop Leaders - Ratna Sudarshan (ISST, India) - Kameshwari Jandhyala (ERU Consultants, India)Peer Assist - Shubh Kumar Range (CoE member India)

5. Gender Evaluation Methodologies Principles and Practice

Workshop Leaders - Anupama Saxena (Guru Ghasidas Central University, India) - Angela M. Kuga Thas (APC, South Africa)

6. Realist Synthesis

- Ray Pawson (University of Leeds, UK)

7. The Use of Appreciative Inquiry (AI) in Evaluation

Workshop Leader - Ana Coghlan (PACT) Peer Assist - Gana Pati Ojha ( CoE member, India)

Time Day - 3 Agenda : 27th October, 2010

02:00 PM - 04:30 PM

04:30 PM - 05:00 PM

05:00 PM - 06:00 PM

01:00 PM - 02:00 PM

Workshop Series 2 continued

Tea Break

Coffee Shop Meetings

1. Evaluation Curriculum and Capacity Building

Host - Soma De Silva (SLEvA, Sri Lanka )

2. Evaluation with Children Challenges, Ethics and Innovations Hosts - Sonal Zaveri ( Child-to-Child Trust and CoE member, India) - Nazmul Kalimullah (U&I, University of Dhaka, Bangladesh)

3. Evaluating Policy Research Challenges and Opportunities

Hosts - Peter Taylor (IDRC, Canada) - Samar Verma (IDRC, India) 4. Evaluating Campaigns: Experience Sharing

Hosts - Paramita Dasgupta (CMS, India) - Anuradha Rajan (Oxfam GB)

5. Ethics in Evaluation

Host - Vinita Tatke

6. Evaluation of Agriculture, Food Security and Natural Resource Management Programs

Hosts - Veena Khanduri (ISID, India) - Gana Pati Ohja (CoE member, Nepal)

7. Evaluation for Social Accountability

Host: - Ravinder Kumar (CMS)

Lunch

ANNEXURE I ANNEXURE I

Time Day - 4 Agenda : 28th October, 2010

09:00 AM - 10:30 AM New Directions in Evaluation Series 3 (Break-out sessions)

1. Evaluation field building: Models for strengthening capacity, knowledge and structures in South Asia Chair - Katherine Hay (IDRC and CoE member India )Panelists - Khilesh Chaturvedi (ASK and CoE member, India) - Dharmendra Chandurkar (Sambodhi , India) - Soma de Silva (SLEvA, Sri Lanka) - Ada Ocampo (Unicef, Thailand) - Nidhi Khattri (IEG, World Bank, United States) - Jayshree Oza (NCERT, India)

2. Digital Storytelling for Gender Evaluation: Reflections from the Experience of the Association for Progressive Communications

44 45

Panelists - Angela M. Kuga Thas ( APC, South Africa) - Anupama Saxena (Guru Ghasidas Central University, India)

Time Day - 4 Agenda : 28h October, 2010

10:30 AM - 11:00 AM

11:00 AM - 1: 00 PM

1:00 PM - 02:00 PM

Tea Break

Workshop Series 2 Ends

Lunch

02:00 PM - 03:30 PM New Directions in Evaluation Series 3 (Break-out sessions)

1. Promoting Evaluation Use: Why Process Matters?

Panelists - Chelladurai Solomon (CoE member, India) - Ricardo Ramizez (Independent Researcher, Canada) - Ann Mizumoto (Technological University, Singapore) - Yvonne Lim Yin Chum ( DECI, Singapore ) - Sonal Zaveri ( Child-to-Child Trust and CoE member, India)

2. Donor challenges in Evaluating Projects versus Systems Change

Chair - Fred Carden (IDRC, Canada)Panelists - Nancy MacPherson (The Rockefeller Foundation, United States) - Belen Sanz (Unifem, United States) - Gale Berkowitz (The Packard Foundation, United States) - Marco Segone (Unicef, United States)

3. Gender, Rights and Transformation: Building Bridges between Evaluation and Change

Panelists - Katherine Hay (IDRC and CoE member India) - Veronica Magar (Reach, India) - Ratna Sudarshan (ISST, India) - Vimala Ramachandran (ERU, India)

Panels of selected paper

4. Evaluating Public Healthcare interventions for program strengthening-2

Chair - Deoki Nandan Sharma(National Institute of Health and Family Welfare, India)Panelists - Anuska Kalita (Centre for Child Health and Nutrition, India) - Gautam Chakraborty (NHSRC, India) - Sangita Dasgupta (Amaltas, India) - Chiara Piaggio (UniCredit Foundation, Italy) - Anita Malhotra (University Of Delhi) - Tarang Sharma (National Institute for Health and Clinical Excellence) - Astad Pastakia (Independent Consultant)

Time Day - 4 Agenda : 28th October, 2010

03:30 PM - 04:00 PM

04:00 PM – 05:00 PM

05:00 PM - 06:00 PM

Tea Break

Plenary Address

IDRC 40th Anniversary: Evaluation and Accountability

Chair - Stephen McGurk (IDRC, India)

Speakers - R. Suresh, (Public Affairs Centre, India) - Gopakumar Kumar Krishan ( Institute of Governance Studies, Bangladesh)

Closing Event

Launch of the Community of Evaluators and call for Members

Speaker - Vinita Tatke (CoE member, India)Event highlights and Concluding remarks - Mallika Samaranayake (SLEvA and member CoE, Sri Lanka) - Khilesh Chaturvedi (ASK and CoE member, India)

ANNEXURE I ANNEXURE I

46 47

ANNEXURE II

48 49

Sr. No. Name Organisation Designation Email1 Aanchal Chomal Azim Premji Foundation Co-ordinator Academics &

Pedagogy ajay@azimpremjifoundation.org

2 Abdul Ghani 3 Abdul Mateen Afghanistan Research and

Evaluation Unit (AREU) Senior Research Assistant mateen@areu.org.af

4 Abhijit Das Centre for Health and Social Justice

Director abhijitdas@chsj.org

5 Abhilash Medhi Afghanistan Research and Evaluation Unit (AREU)

Research Officer abhilash@areu.org.af

6 Ada Ocampo UNICEF UNICEF Asia Pacific Regional Evaluation Advisor

7 Afshan Ahmed Sustainable Development Policy Institute (SDPI)

Research Coordinator afshan@sdpi.org

8 Ajay Batra Azim Premji Foundation Head – Assessment & Development Center

ajay@azimpremjifoundation.org

9 Alan Mackenzie British Council Senior Training Consultant alan.mackenzie@in.britishcouncil.org10 Alison Barrett British Council Head State Partnerships alison.barrett@in.britishcouncil.org11 Alok Vajpeyi Catholic Relief Services Director , Monitoring and

Evaluation avajpeyi@crsindia.org

12 Amarsanaa Darisuren UNIFEM East and Southeast Asia Subregional Office

Human Rights Specialist amarsanaa.darisuren@unifem.org

13 Ambika Sharma IDRC Canada Partnerships and Research Officer

asharma@idrc.org.in

14 Amit Kumar Shrivastava School of Good Governance & Policy Analysis (An Autonomous Organisation of Govt. of M.P.)

amit.aks@gmail.com

15 Amrita Singh UNICEF India Knowledge Management Officer

16 Ana Coghlan Pact Monitoring and Evaluation Regional Advisor

acoghlan@pactworld.org

17 Anand Akundy Administrative Staff College of India BellaVista, Rajbhavan Road ,Hyderabad 500082 India

akundy@asci.org.in

18 Anand P. Gupta Economic Management Institute

Director anand@EconomicManagement.com

19 Anil Kumar Sharma National Council of Applied Economic Research (NCAER)

aksharma@ncaer.com

20 Anita Malhotra Delhi University Associate Professor anitamalhotra28@gmail.com21 Anita Malhotra Lakshmibai College

(University of Delhi) &Institute of Home Economics (University of Delhi)

Associate Professor anitamalhotra28@gmail.com

22 Anjal Prakash SaciWATERs Senior Fellow Anjal@saciwaters.org23 Anjini Mishra amishra@3ieimpact.org24 Anna Brown Rockefeller Foundation Associate Director 25 Anuska Kalita ICICI Centre for Child

health and Nutrition Senior Associate anuska.kalita@gmail.com

26 Anwarul Haq Jabarkhail IbnSina Institute of Public Health and Management Sciences (IPHMS),Afganistan

ibnsinaprd@ibnsina.org.af,ibnsinaprd@yahoo.co.uk

Sr. No. Name Organisation Designation Email27 Aparna Seth Sambodhi Deputy Manager 28 Aparupa Negi Sambodhi Senior Manager 29 Arun Virk International Initiative for

Impact EvaluationProgram Officer avirk@3ieimpact.org

30 Arundhati Ghosh India Foundation for the Arts

Deputy Director arundhatighosh@indiaifa.org

31 Asela Ranjith Lal Kalugampitiya

International Development Law Organization (IDLO)

Monitoring, Reporting and Information Consultant

aselakalugampitiya@yahoo.ie

32 Asha Kowtal National Campaign on Dalit Human Rights – AIDMAM

General Secretary asha.kowtal@ncdhr.org.in

33 Ashoke Chatterjee Independent Consultant ashchat@prabhatedu.org34 Ashutosh Kumar Shukla Nepal Engineering

College Professor shuklashailaja@yahoo.com

35 Ashvin Dayal Rockefeller Foundation Managing Director adayal@rockfound.org36 Astad Pastakia Self Employed astadp@gmail.com37 Atanu Majumdar Micro Insurance Academy Senior Resaercher atanu@mia.org.in38 Basundhara Bhattarai Woman Organising for

change in Agriculture and Natural Resources Management

Advisor basu.bhattarai@gmail.com

39 Belen Sanz Unifem Evaluation advisor belen.sanz@unifem.org40 Benjamin Sovacool TERI 41 Bhabatosh Nath Responsive to

Integrated Development Services(RIDS

Executive Director bhabatoshnath@gmail.com

42 Bhujendra Nath Panda NCERT Reader, RIE, Bhubaneswar bnpanda38@hotmail.com43 Bijay Kumar Panda Infrastructure

Professionals Enterprise Pvt Ltd

Project Associate bijaypanda.icfai@gmail.com

44 Bikram Gupta Sambodhi Deputy Manager bikram@sambodhi.co.in 45 Bindiya Rawat Association for

Stimulating Know How (ASK)

Manager bindiya@askindia.org

46 Bishwanath Goldar Institute of Economic Growth

Professor bng@iegindia.org

47 Brad Cousins University of Ottawa Professor bcousins@uottawa.ca48 Brian Lund 49 C.Nicholas Integrated Rural

Development SocietySecretary and Coordinator Nicholas.irds@yahoo.com

50 Carolyn Israel Sobritchea carolyn.sobritchea@gmail.com51 Catrina Lucero iScale (Innovations for

Scaling Impact) clucero@scalingimpact.net

52 Chandra Shekhar Silori RECOFTC Senior Programme Officer Chandra.silori@recoftc.org53 Chelladurai Solomon Free-lance Consultant Development Management

Consultantchelladurai_solomon@hotmail.com

54 Clare Shakya DFID 55 Colleen Duggan IDRC Canada Senior Program Specialist cduggan@idrc.ca56 D.S.Rajakumar consultant rajakumar.sankar@gmail.com 57 Darini Rajasingham 58 Debazou Y. Yantio yantio@hotmail.com59 Deepak Kumar Biswal National Rural Health

Mission – OrissaConsultant – Monitoring & Evaluation

dmpdeepak@gmail.com

60 Devyani Srinivasan Monitoring and Evaluation Consultant

Devyani.oskarsson@gmail.com

ANNEXURE II ANNEXURE II

50 51

Sr. No. Name Organisation Designation Email61 Dharmendra Sambodhi Chief Knowlegde Officer 62 Dipa Nag Chowdhury Macarthur Foundation Acting Director dnagchowdhury@macfound.org63 Diya Dutta Unifem SARO Research Analyst diya.dutta@unifem.org 64 Diya Nanda UNIFEM Programme Assistant Diya.nanda@unifem.org65 Donna M. Mertens Gallaudet University donna.mertens@gallaudet.edu66 Dora Chaudhuri GOAL India Field Office Programme Manager goal@goalindia.org67 Dushni Weerakoon Institute of Policy Studies

of Sri LankaDeputy Director dushni@ips.lk

68 E.M.Ratique Care India Team Leader mratique@careindia.org69 Ekta Bartarya Gorakhpur environment

Action Group

70 Erynn Carter 71 Eswaran Subrahmanian Center for Study of

Science , Technology and Policy (CSTEP

Research Fellow sub@cstep.in

72 Evelyn Suleeman evelyn_suleeman@yahoo.com73 Farzana Bari Center of Excellence in

Gender Studies, Quaid-e-Azam University

Director Farzana@comsats.net.pk

74 Fauzia Yazdani The Consulting Researchers

Executive Director auziayazdani@gmail.com

75 Ferdous Jahan BRAC Development Institute, BRAC University and University of Dhaka

Associate Professor jahan70@gmail.com

76 Fred Carden IDRC Canada Director, Evaluation fcarden@idrc.ca77 G. ISRAEL Janodayam Social

Education Centre (CCFD Registration)

Project Director janoisrael@yahoo.co.uk

78 Gajendra Singh WHO-National Polio Surveillance Project

talk2me@doctor.com

79 Gale Berkowitz Packard 80 Gana Pati Ojha Gyankunj Eduacational

FoundationChairperson gpojha@gmail.com

81 Gautam Chakraborty National Health Systems Resource Centre (NHSRC)

Advisor - Health Care Financing & Research officer-Health Economics & Financing

hfinnhsrc@gmail.com

82 George F Grob Center for Public Program Evaluation, USA

georgefgrob@evaluationcenter.ne,georgefgrob@cs.com

83 Godfrey Bbalo Evaluation and Monitoring Consultants

Enablus Resources Consultants

godfreybbalo@yahoo.com

84 Goele Scheers Global Partnership For The Prevention (GPPAC)

g.scheers@conflict-prevention.net

85 Golam M Chowdhury University & Industry Alliance, (U&I), University of Dhaka, Bangladesh

gmc@uni-alliance.edu.bd,gmgmc_iba@hotmail.com,gm.chowdhury@ibu.du.edu

86 Habibullah Sahak IbnSina Institute of Public Health and Management Sciences (IPHMS), Afganistan

ibnsinaprd@ibnsina.org.af,ibnsinaprd@yahoo.co.uk,zlanwari@msh.or

87 Habibullah Sahak IbnSina Institute of Public Health and Management Sciences (IPHMS), Afganistan

ibnsinaprd@ibnsina.org.af,ibnsinaprd@yahoo.co.uk,zlanwari@msh.or

Sr. No. Name Organisation Designation Email88 Huong Nguyen David and Lucile Packard

Foundation hnguyen@packard.org

89 I.K. Bansal NCERT Professor, NIE, NCERT inderkuarbansal@yahoo.co90 Indira Ariyaratne University of Sri

Jayawardenepura,Sri Lanka

mida345@yahoo.com

91 Indranil Sambodhi 92 Inga Sniukaite Unifem Evaluation Specialist inga.sniukaite@unifem.org93 Ipshita Basu Institute of Governance

Studies (IGS)Head of Research ipsbasu@gmail.com

94 Janardan Ipas- India 95 Jawid Najumyar UNIFEM EVAW Special Fund Assistant jawid.najumyar@unifem.org 96 Jay Chaubey UNICEF Consultant 97 Jaya Sharma Nirantar Project Co- ordinator jayajulie@gmail.com98 Jayatirtha Asundi Center for Study of

Science, Technology and Policy

Principal Research Scientist asundi@cstep.in

99 Jeetendra Patnaik Infrastructure Professionals Enterprise Pvt Ltd

E-Health, M & E Specialist, Orissa TMST

jeetupat@hotmail.com

100 Jim Rugh RealWorld Evaluation independent consultant JimRugh@mindspring.com101 Joaquin Gonzalez Aleman UNICEF Chief, Social Policy, Planning,

Monitoring and Evaluation

102 John Cosgrave Active Learning Network for Accountability and Performance in humanitarian action (ALNAP)

johncosgrave@gmail.com _

103 Jose Roi B. Avena Rural Micro Enterprise Promotion Programme (RuMEPP)

Monitoring and Evaluation Specialist

roi_avena@yahoo.com; roi.avena@gmail.com

104 Joseph Frederick World Vision India Evaluation Manager joseph_frederivck@wvi.org105 Julia Suryantan Church World Service

Indonesia j.suryantan@gmail.com

106 Jyotsna Bapat Institute of Sustainable Development &TN IAMWARM Project

Independent Consultant jbapat2002@yahoo.com

107 Jyotsna Silting Independent Consultant jsitling@yahoo.com108 K. Venkateshwar Rao National institute of

Agricultural Extension Mannagement

Faculty cum Trainer kasinavrao@iitb.ac.in

109 Kameshwari Jandhyala ERU Consultants Pvt Ltd Director kameshwarij@gmail.com110 Kamini Prakash Pravah Director – Research prakash.kamini@gmail.com 111 Karin Fernando Centre for Poverty

Analysis (CEPA)Senior Professional – Poverty Impact Monitoring Programme

karin@cepa.lk

112 Karl Hughes Oxfam GB Global MEL Adviser, Programme Effectiveness

kahughes@oxfam.org.uk

113 Kiran Devendra NCERT SSA - TC fund - Technical Services Agency

tsa.ncert@gmail.com

114 Kiran Kamal Prasad JEEVIKA Coorodinator jeevika90115 KN Pathak, Planning

Commission knp.pathak@gmail.com

116 Kumudu Wijewardene University of Sri Jayawardenepura,Sri Lanka

rashmikd@sltnet.lk;

117 Kumudu Wijewardene

ANNEXURE II ANNEXURE II

52 53

Sr. No. Name Organisation Designation Email118 Kurt Mcleod Pact Vice President Asia Eurasia KMcleod@pactworld.org119 L.A. Samy Association of

Rural Education and Development Service (AREDS)

Executive Director aredsind@gmail.com

120 Lalitendu Population Foundation of India

lalitendu@popfound.org

121 Lata Pandey NCERT Professor, NIE, NCERT latapandet@ncert.nic.in122 Lester Coutinho Packard Foundation Country Advisor, India lcoutinho@packard.org 123 Lily Thapa Women for Human Rights Executive Director lily@mos.com.np124 Lindsey Novak International Initiative for

Impact Evaluation (3ieEvaluation Officer lnovak@3ieimpact.org

125 Linnea Madelen Eichhorn Unaids EichhornM@unaids.org 126 Liz Drake DFID 127 M Ubaidullah Sri Venkateswara

UniversityProfessor and chairperson ubaidullahm@rediffmail.com

128 M. J. Joseph Praxis Head- Soth Indian Operations josephm@praxisindia.org129 M.V. Srinivasan NCERT SSA - TC fund - Technical

Services Agencytsa.ncert@gmail.com

130 Maithree Wickramasinghe University of Kelaniya maithreeuk@yahoo.co.uk / mkwickramasinghe@gmail.com

131 Malathi Weerasooriya University of Sri Jayawardenepura,Sri Lanka

Malathiw4474@gmail.com

132 Mamta Baxi Cosmo Foundation Program Coordinator mamta_baxi@yahoo.com,cosmo_foundation@yahoo.in

133 Mamta Kohli DFID 134 Manish Kumar Program Manager Centre for Urban and Regional

Excellence (CURE)manish118@gmail.com

135 Manish Naithani Sambodhi Project Management Advisory Manish@sambodhi.co.in136 Manju Jain NCERT Professor, NIE, NCERT mjainncert@yahoo.co.in137 Mansi Kumarasiri Centre for Poverty

Analysis (CEPA) Sri Lanka

138 Mansi Mahajan ACCESS Development Services

Project Coordinator mansi@accessdev.org, mansi.mahajan@yahoo.com

139 Marco Segone UNICEF , New York Systemic Management msegone@unicef.org140 Margaret Anne Bramble Caribbean Development

BankDeputy Director, Evaluation and Oversight Division

brambla@caribank.org

141 Maria Shahabi Health Net TPO Technical Advisor for EVAW-II project

maria.shahabi@yahoo.com

142 Mario Mosquera UNICEF Prog Com Specialist mmosquera@unicef.org143 Mary Sheehan International Organization

for MigrationChief of Mission msheehan@iom.ge

144 Matt Reeves Pact Global Director, Capacity Development

mreeves@pactworld.org

145 Matthew L. Smith IDRC Canada Program Officer msmith@idr.ca146 Meena Menon meenamen@gmail.com147 Michiru Sugi UNICEF Research & Evaluation

Specialistmsugi@unicef.org

148 Mohammad Rezaur Rahman

Professor rezaur@iwfm.buet.ac.bd

149 Mudit Kapoor Indian School of Business Assistant Professor of Economics

mudit_kapoor@gmail.com

Sr. No. Name Organisation Designation Email150 Muhammad Shah Alam

Khan Institute of Water and Flood Management (IWFM), Bangladesh University of Engineering and Technology (BUET)

Professor msalamkhan@iwfm.buet.ac.bd

151 Muhammad Asif Iqbal Social Policy and Development Centre

Principal Economist/Company Secretary

asifiqbal@spdc.org.pk

152 Musimbi Kanyoro David and Lucile Packard Foundation

Director, population and Reproductive Health

mkanyoro@packard.org

153 Musimbi Kanyoro Packard 154 N Ragunathan Panelist 155 N. Dayalan Human Resource

Development Foundation (HRDF)

Director dayalanhrdf@gmail.com

156 Nabesh Bohidar Care India Team Leader nbohidar@careindia.org157 Nancy J Anabel M S Swaminathan

Research FoundationPrincipal Scientist anabel@mssrf.res.in

158 Nancy Macpherson Rockefeller Foundation Associate Director nmacpherson@rockfound.org159 Naomi Niroshinie

Nayagam The Asia Foundation Technical Advisor, Economic

Policy Advocacynnayagam@asiafound.org

160 Narendra Singru Asian Development Bank Senior Evaluation Specialist nsingru@adb.org161 Navneet Kaur Sambodhi Senior Manager - Research navneet@sambodhi.co.in 162 Nazmul Ahsan Kalimullah University & Industry

Alliance, (U&I), University of Dhaka, Bangladesh

janipop1@yahoo.com;

163 Niamh Brannigan Global e‐Schools and Communities Initiative

Communications Manager niamh.brannigan@gesci.org

164 Niamh Brannigan Global e‐Schools and Communities Initiative

Communications Manager niamh.brannigan@gesci.org

165 Nidhi Khattri The World Bank Senior Evaluation Officer nkhattri@worldbank.org166 Nidhi Sadana Sabharwal Indian Institute of Dalit Principal Research Fellow nidhi@dalitstudies.org.in167 Nihar Ranjan Mishra Population Foundation of

IndiaProgramme Officer nihar@popfound.org

168 Nihar Ranjan Mishra Population Foundation of India

Programme officer (M&E) nihar@popfound.org

169 Nilakshi De Silva Centre for Poverty Analysis (CEPA) Sri Lanka

nilakshi@cepa.lk

170 Nilanthi Bandara University of Sri Jayawardenepura,Sri Lanka

nbandara@sltnet.lk

171 Nilusha Kapugama LIRNEasia nilusha@lirneasia.net172 Nirmal kumar World Vision India National Coordinator -Quality

Assurancenirmalkumar@wvi.org

173 Niroshinie Nayagam The Asia Foundation Technical Advisor – Economic Policy Advocacy

174 Olanrewaju Olaoye University of Lincoln oolaoye@lincoln.ac.uk175 P.P.Sivapragasam ( S

iva) Human Development Organization (HDO), Sri Lanka

President Sivahdo@gmail.com

176 P.V. Baiju Sree Sankaracharya Universiyt of Sanskrit

Asst Prof in Social Work tobaiju@gmail.com

177 Padma Yadav NCERT SSA - TC fund - Technical Services Agency

tsa.ncert@gmail.com

178 Pankaj Kumar Shrivastav UNIFEM M & E Specialist pksddn@gmail.com179 Partha Saha, IAMR partha.saha@nic.in

ANNEXURE II ANNEXURE II

54 55

Sr. No. Name Organisation Designation Email180 Parul Sharma Sambodhi Senior Manager - Research Parul@sambodhi.co.in181 Penelope Student School of Health Related

Research , University of Sheffield

psiebert@btopenworld.com

182 Peter Taylor IDRC Canada Senior Program Specialist ptaylor@idrc.ca183 Petra Burcikova UNIFEM Programme Specialist petra.burcikova@unifem.org 184 Pierre Fallavier Afghanistan Research

Evaluation Unit (AREU) Director pierre@areu.org.af

185 Poonam Muttreja Population Foundation of India

Exective Director pmuttreja@popfound.org

186 Prabha Sethuraman IDRC Canada Executive Assistant/Communication Officer

psethuraman@idrc.org.in

187 Pradeep Narayan Praxis Head research and consultancy pradeepn@praxisindia.og188 Pradeep Panda Micro Insurance

Academy(3ie)Senior Resaercher pradeep@mia.org.in

189 Pragya Pranjali Sambodhi Senior Manager pragya@sambodhi.co.in190 Pramel Gupta Vrutti Livelihood

Resource Center Regional Manager pramel.gupta@gmail.com, pramel@cms-

india.org191 Pramel Gupta Vrutti Livelihood

Resource Center Regional Manager pramel.gupta@gmail.com, pramel@cms-

india.org 192 Pramita Harjati Mercy Corps Project Coordinator 193 Pranati Patnaik Wetlands International-

South AsiaProject Officer pranati.patnaik@wi-sa.org

194 Pranita Achyut International Center for Research on Women

Poverty, gender and HIV AIDS Specialist

pachyut@icrw.orrg

195 Pranoti Chirmuley Packard Foundation 196 Prathaban (Ben)

RamalingamActive Learning Network for Accountability and Performance in humanitarian action (ALNAP)

b.ramalingam@alnap.org_

197 Priya Balasubramaniam Public Health Foundation of India

Senior Public Health Specialist

priya.balu@phfi.org

198 Priyanka Sharma Magic Bus Programme Head priyanka@magicbusindia.org199 Puja Roy Freelance Consultant Consultant: Gender, Diversity

and Rights roy_puja@hotmail.com

200 Putsata Reang Pact Institute SEA Change Community of Practice Team Leader

preang@pactworld.org

201 R. Bhakther Solomon Development Promotion Group

CEO dpgsulo@md2.vsnl.net.in

202 R.S.Goyal Institute of Health Management Research

sgoyal@iihmr.org

203 Rachael Ray 204 Rachna Gahilote Bisht UNIFEM Prrogram Associate rachna.bisht@unifem.org205 Radhika Menon 3ie Advocacy & Communication

Consultantrmenon@3ieimpact.org

206 RaJ K. Verma Nagaland Empowerment Of People Through Economic Development(NEPED)

Deputy Team Leader rkverma.ncs@gmail.com

207 Rajesh Sada Nepal Engineering College

Research Coordinator (Peri-urban Water Security Project)

rajesh_sada@hotmail.com

208 Ram Chandra Khanal Freelance Researcher CoE Member khanalrc@gmail.com 209 Ram chandra Lamichhane Imagine Nepal are_see@hotmail.com, imaginenepal@

wlink.com.np ,

Sr. No. Name Organisation Designation Email210 Ramesh Man Tuladhar Community of Evaluators

(COE), South AsiaFounder Member r.tula1950@gmail.com

211 Ramesh Man TULADHAR

Community of Evaluators (COE), South Asia

Founder Member r.tula1950@gmail.com

212 Rania Roushdy Population Council-WANA office

Senior Research Manager rroushdy@popcouncil.org

213 Ratna M. Sudarshan Institute of Social Studies Trust

Director ratna@isst-india.org

214 Ray Pawson University of Leeds Professor of Social Research Methodology

.d.pawson@leeds.ac.uk

215 Razdan Sarim Rahman Sambodhi Manager - Research razdan@sambodhi.co.in216 Reena Tete Rangoonwala Foundation

(India) reenatete@gmail.com

217 Rema Saraswathy Institute of Sustainable Development

Member Secretary remasaraswarthy@gmail.com

218 Renuka Motihar Independent Consultant renuka.motihar@gmail.com219 Rishikesh B.S Azim Premji Foundation Leader – Research &

Documentation ajay@azimpremjifoundation.org

220 Robert D. Van den Berg 221 S Gregory Kannur University Associate Professor and Head gregorys3@gmail.com222 Sabita Thapa 223 Sabita Thapa Stockholm Environment

InstituteResearch Fellow Sabita.thapa@sei.se

224 Saktida Singh UNIFEM Programme Office Nepal

Programme Officer saktida.singh@unifem.org

225 Sam Kernaghan Senior Consultant Arup Thailand sam.kernaghan@arup.com226 Samar Verma IDRC-SARO Senior Program Officer, Think

Tank Initiativesverma@idrc.ca

227 Sanda Thant Mekong university Programme Manager sanda.thant@gmail.com228 Sandhya Paranjpe NCERT Professor, NIE, NCERT sandhyapncert@rediffmail.com229 Sangita Dasgupta Amaltas Project associate sdasgupta@amaltas.asia,230 Sanjeev Khagram iScale (Innovations for

Scaling Impact) skhagram@scalingimpact.net

231 Sanjeev Sridharan University of Toronto, Canada

sridharans@smh.ca,sridharans@smh.toronto.on.ca

232 Sara Ahmed 233 Sara Duke Independent Consultant voxrva@yahoo.com234 Sarah Earl IDRC-SARO Senior Program Specialist searl@idrc.ca235 Sarbjit Singh Sahota UNICEF Emergency Specialist sssahota@unicef.org; 236 Sashi Kumar Yugantar Exec Director sashi@yugantar.org.in237 Shalini Kala IDRC Canada Program officer skala@idrc.org.in238 Shamika Ravi Indian School of Business Assistant Professor of

EconomicsShamika_ravi@isb.edu

239 Shan Mitra DFID 240 Shilpi Mishra Sharma IIHMR Asst Prof mishra.shilpi@gmail.com, shilpi@iihmr.

org241 Shiv Kumar UNICEF ,India Senior Advisor 242 Shubh K. Range CoE shubhk.range@gmail.com243 Sofia UNIFEM Program Associate in Gender

and Justice Unitsofia.moazizi@unifem.org

244 Soma De Silva Sri Lanka Evaluation Association,Sri Lanka

somadesilva@gmail.com

245 Sona Sharma Population Foundation of India

Joint Director ( Advocacy and Communication)

sona@popfound.org

ANNEXURE II ANNEXURE II

56 57

Sr. No. Name Organisation Designation Email246 Sonal Zaveri Independent Consultant,

Founder Member, Community of Evaluators

sonalzaveri@gmail.com

247 Sonia Kakar Project HOPE Program Manager/ Finance and Administrative Officer

skakar@projecthope.org

248 Sowmyaa Bharadwaj Praxis Programme Manager – Research and Consultancies

sowmyaab@praxisindia.org

249 Sreeja Nair 250 Sreoshi Singh SaciWATERs 251 Stefan Nachuk Rockefeller Foundation Associate Director snachuk@rockfound.org252 Subarna Mathes Innovations for Scaling

Impact (iScale) smathes@scalingimpact.net

253 Subodh Kumar World Vision India Program Director subodh_kumar@wvi.org254 Sugandhi Baliga Sir Dorabji Tata Trust,

Mumbai Senior Program Officer sbaliga@sdtatatrust.com

255 Sujoy Chaudary freelance Consultant Programme Manager goal@goalindia.org256 Suneeta Singh Amaltas CEO ssingh@amaltas.asia257 Suresh Raghavan Public Affairs Center Director director@pacindia.org258 Sushanta K. Banerjee Ipas- India Senior Advisor - Research &

Evaluationbanerjees@ipas.org

259 Swapnil Shekhar Sambodhi Chief Operating Officer swapnil@sambodhi.co.in260 Syed Khairul Islam Independent Consultant kislam09@gmail.com 261 Sylvain Ropital CCFD-France (Catholic

Committee against Hunger and for Development)

South Asian Project Officer s.ropital@ccfd.asso.fr

262 Tamara C.Daley Westat India Social Sciences

General Manager, Research & Operations

tamaradaley@westat.in

263 Tarang Sharma National Institute for Health and Clinical Excellence (NICE)

Senior Analyst Tarang.Sharma@nice.org.uk

264 Terry Thomas Wilbur Smith Associates Project Manager tthomas@willbursmith.com265 Undurthy

LakshminarayanaNCERT Reader, RIE, Bhopal undurthy@gmail.com

266 Usha Rani Vyasulu Reddy Independent ICT and Development Consultant

reddi.usha@gmail.com

267 Valthsala IDRC Canada Program Assistant valthsala@idrc.org.in268 Varaporn Chamsanit Center for Human Rights

Studies and Social Development, Mahidol University

Faculty Staff and Acting Director

varaporn.chamsanit@gmail.com

269 Varun Bangia Sambodhi Senior Manager - Research drvarunbangia@gmail.com270 Veena Khanduri India Water Partnership-

IWPAdviser veenakhanduri@yahoo.com

271 Veena Vidyadharan CECOEDECON cecoedecon@gmail.com, veena_sanz@rediffmail.com

272 Velayuthan Sivagnanasothy

UNICEF

273 Veronica Magar 274 Véronique McKinnon IDRC Canada Research Officer vmckinnon@idrc.ca275 Vidhi Sambodhi Deputy Manager vidhi@sambodhi.co.in276 Vidhu Kapur Sambodhi Sr. Executive - Research vidhu@sambodhi.co.in277 Vimala Ramachandran ERU Consultants Private

LimitedDirector erudelhi@gmail.com

278 Vinita Tatke GreenEarth Social Development Consulting Pvt Ltd, Pune

Director vinitat@vsnl.com

Sr. No. Name Organisation Designation Email279 Vinod Kumar Srivastava Agribusiness Systems

International-ASIMonitoring & Evaluation Specialist

vkumar@sunhara.org

280 Virinder Sharma DFID 281 Vishal Narain Management

Development Institute Associate Professor vishalnarain@mdi.ac.in

282 Vishwa Prakash Project HOPE Program Manager/ Finance and Administrative Officer

vprakash@projecthope.org

283 Vyjayanthi Sankar Educational Initiatives Pvt Ltd.

Vice President-Large Scale Assessments

vs@ei-india.com

284 Ximena Fernandez-Ordonez

The World Bank Consultant xfernandezordone@worldbank.org

285 Y Dayanand Singh Amaltas Research Analyst ydsingh@amaltas.asia286 Yamini Mishra UNIFEM SA SRO yamini.mishra@gmail.com 287 Yamun Yadav UNIFEM Programme

Office NepalProgramme Support Manager yamun.yadav@unifem.org

288 Yuka Hasegawa Active Learning Network for Accountability and Performance in humanitarian action (ALNAP)

Research Officer y.hasegawa@alnap.org__

289 Yustina Rostiawati yustina.rostiawati@atmajaya.ac.id; yustina.rostiawati@yahoo.com

290 Zia Hussain Afghanistan Research Evaluation Unit (AREU)

Research Assistant zia@areu.org.af

291 Zulaikha IbnSina Institute of Public Health and Management Sciences (IPHMS), Afganisthan

ibnsinaprd@ibnsina.org.af,ibnsinaprd@yahoo.co.uk,ibnsinacom@ibnsina.org

ANNEXURE II ANNEXURE II

58 59

Coffee Shop Meetings