welcome to the webinar evaluation of pro-poor urban ... · julian barr robbie gregorowski...
TRANSCRIPT
WELCOME to the webinar
“Evaluation of pro-poor
urban interventions.” 28 June 2012
This Live Webinar will start at 1:00 PM New York time.
All microphones & webcams are disabled and we will only enable microphones during
the Q&A portion.
Therefore, you will not hear any sound/noise till the beginning of the webinar.
Series of 17 live webinars on
“Equity-focused Evaluations” Interact live with 28 world-level evaluators
This series of webinars addresses the challenges and
opportunities in evaluating the effects of policies, programmes
and projects to enhance equitable development results, with a
special focus on the effects to the most excluded, marginalized
and deprived groups.
Colin KIRK
Penny HAWKINS
Evaluation to accelerate progress towards
equitable development
6 September 2011
9:30 AM NY time
Belen SANZ
Flaminia MINELLI
Human rights and Gender equality in evaluations
21 September 2011
9:30 AM NY time
Marco SEGONE
Michael BAMBERGER
How to design, implement and use equity-
oriented evaluations
4 October 2011
11:30 AM NY time
Saville KUSHNER
Case study evaluation as an intervention for
promoting equity
11 October 2011
9:30 AM NY time
Bob WILLIAMS
Martin REYNOLDS
Systems approach (CSH) to address ethical
issues
14 November 2011
3:00 PM NY time
Patricia ROGERS
Richard HUMMELBRUNNER
Program theories and LogFrames to evaluate
pro-poor and equity programs
22 November 2011
4:00 PM NY time
Michael Quinn PATTON
Developmental Evaluation
6 December 2011
11:30 AM NY time
Webinars on Equity-focused Evaluation 2011
Webinars on Equity-focused Evaluation 2012
Donna MERTENS
Methodological guidance in evaluation for Social
Justice
24 January 2012
9:30 AM NY time
Jennifer GREENE
Values-Engaged Evaluation
15 February 2012
1:00 PM NY time
Michael Quinn PATTON
How to evaluate interventions in complex
dynamic environments?
28 February 2012
11:30 AM NY time
Rodney HOPSON
Katrina BLEDSOE
Cultural Responsiveness in Applied Research
and Evaluation Settings
15 March 2012
2:00 PM NY time
Juha UITTO
Oscar A. GARCIA
Evaluating equity-focused public policies. The
case of Brazil and Mexico
27 March 2012
9:30 AM NY time
Katherine HAY
Ratna SUDARSHAN
Strengthening Equity-focused evaluations
through insights from feminist theory and
approaches
15 May 2012
8:30 AM Delhi (India) time
10:00 AM Bangkok (Thailand) time
11:00 AM Manila (Philippines) time
Julian BARR
Robbie GREGOROWSKI
Evaluation of climate change interventions for
excluded populations
11 June 2012
1:00 PM NY time
Sulley GARIBA
Evaluation of pro-poor urban interventions
28 June 2012
1:00 PM NY time
Guy THIJS
Francisco GUZMAN
Evaluation of the ILO’s strategy to eliminate
discrimination in employment and occupation
To be announced.
Webinars on Equity-focused Evaluation 2012
Interact with Questions and Answers
Type here
Keynote Speakers
Sulley Gariba, Institute for Policy Alternatives (IPA), Ghana
“Evaluation of pro-poor urban interventions”
Agenda 1:00 – 1:05 PM Welcome and introduction
Marco Segone, Systemic Management,
UNICEF Evaluation Office
1:05 – 1:25 Sulley Gariba, Institute for Policy Alternatives (IPA), Ghana
1:25 – 1:55 Questions and Answers
Moderator: Stewart Donaldson, Dean & Chair of Psychology
School of Behavioral & Organizational Sciences,
Claremont Graduate University
1:55 – 2:00 Wrap-up: Penny Hawkins, Evaluation Office,
The Rockefeller Foundation
Evaluation of pro-poor
urban interventions
Sulley Gariba
Institute for Policy Alternatives (IPA), Ghana
Overview
• Nature of Urban Poor Networks
• Rights and responsibilities of urban poor networks in
the evaluation process
• Experiences in Learning, Monitoring and Evaluation
• Lessons learned and future work-in-progress
Urban Poor Networks
• Emergence of urban grassroots networks
• Social movements situated within the development sector,
where collective action has become an imperative
• Not your typical development agency
• Based on mass membership
• Demand for services are internally generated
• Bias towards downward accountability
About SDI
• Presence in 388 cities across 33 countries in the global south
• Over 1.1 million members globally
• 10,000 ha of land secured (Equal to a large city)
• Resources leveraged valued at $37.3m
• 55,000+ houses constructed
• Partnerships with local, regional and national governments, academia, multilaterals, domestic development partners, notably, municipalities and central government agencies
WHAT ARE THE PRO-POOR URBAN
INTERVENTIONS
• Land rights
• The right and capacity to organize, mobilize,
enhance voices of the poor
• Access to improved housing
• Access to, and control of social services – water,
sanitation, improved health
• Opportunities to reflect, share knowledge and
assess progress
Processes of Change: Organize, Mobilize Citizens for Action
External
threat:
Eviction
triggers
action
Capacity in Self Monitoring,
Evaluation and Learning Stage 1
• Enumeration & mapping: Tool designed to generate
socioeconomic and spatial data on informal
settlements.
• Builds information as basis for community prioritization of
development actions
• Allows community to track growth & change
• Builds legitimacy and facilitates scaling up
• Creates basis for interactions with external actors through
the generation and management of community-generated
evidence
Capacity in Self Monitoring,
Evaluation and Learning 2
• Daily Savings: Tool for building organization and
resources within communities
• Tracking community savings
• Community forums for reflection and action
• Building systems and culture of accountability
• Creates financial/economic knowledge base
Capacity in Self Monitoring,
Evaluation and Learning 3
• Peer Exchanges: Primary learning & monitoring tool
• Learning through action & experience on the ground
• Assessing most significant changes & learning through
dialogue, exchanges and reviews
Key Experiences – Case
Studies • SDI worked with IPA (in Africa) and PRIA (in Asia) to
strengthen their own LME capacity at the affiliate level.
• The movements in both Kenya and Uganda undertook strategic planning as the basis for developing an instrument for program monitoring, beginning with a deep understanding of their own theories and cultures of change
• Ghana has been selected as a comparison case for the purposes of this presentation.
Growing Towards
Accountability
• At the formative stages of the movements, NGOs take
up the roles of facilitating planning, fundraising,
monitoring and evaluation.
• As the movements grow they acquire organizational
capacities and assume increasing say and capacity
for the use of resources, and for developing tools for
self-monitoring
• With this comes greater responsibility for external
accountability.
Ghana: Organic LM&E
Process
• No external intervention
• Focus on strengthening internal accountability
• The movement strengthened its systems of monitoring
efficiencies and horizontal growth indicators (i.e. number of
members, savings, loans etc.)
• Similar to the organic LME capacities found in many
movements
Uganda: Conventional LME
situation • Emerging federation in Uganda working closely with
NGO – parallel to typical development intervention
• Subsequent consequences for LME include:
Responsibility NGO Movement
Planning Program, project and output
planning
Engages in Single activity
planning
Fundraising Proposal preparation,
negotiation,
Minimal or no participation
Implementation Program, project & output
implementation
Engages in Single activity
implementation
Monitoring Output monitoring Accounting for activity results
Evaluation
Not yet – assumption NGO
would be responsible for future
evaluations, or process
contracted to external
evaluation agencies
Not yet – implication
community as subjects
KENYA: LM&E FOR SOCIAL
MOVEMENT
• The NGO developed a statement of intent that
responded to the plans developed by the
movement.
• Evolved a system for empowerment that used
measurable indicators to develop the vision and
“intensions” of the desired changes
• Derived planning parameters on what actions, by
who and who
Kenya LM&E enhances
planning & empowerment Statement of intent
formulated as mission
statements
• Framing the LM&E process
Converted to major results (outcomes) defined in
measurable terms
• Defining key outcomes and their indicators
Process of change developed as key
actions/activities to acheive these
Outcomes
• Monitoring key outputs in the process of change
• Learning and sharing experiences
Working in Partnership to change
evaluation paradigms • Building of trust and mutual respect between citizens and their agents of
change – SDI-affiliated NGOs, Federation movements of the poor.
• For evaluation and learning facilitators, “Getting to know you” period –
go/no go point; an interaction phase and then implementation phase,
guided by mutual capacities
Interest of urban poor networks (SDI)
• How can these networks better articulate to the outside world the larger
change they are working towards? How can they better tell their story?
• How can LME be used to strengthen an existing culture of “bottom up”
learning which allows for significant and constant course correction?
YES, there was a funder, the Rockefeller Foundation:
• Also assumed a learning mode -- How to support grantees to better do
their work, to record and assess results of collective actions?
Learning on Rights and
Responsibilities
• How do social movements develop a monitoring
and evaluation system that addresses upward
accountability while remaining true to the self
evaluating character of the movement?
• How do you reflect the rigorous and organic downward
accountability to the instruments of evaluation?
• SDI recognizes downward accountability is equally
important. It however supports horizontal (peer)
monitoring and evaluation across affiliated country
movements.
Re-thinking M&E for social
movements
• What implications does the growth of social
movements in development have on resource
requirements, both technical and financial, for the
evaluation sector?
• How do we create sensitivity to urban poor
movements in development evaluation sector
(AFrEA, AEA, Grant-makers, like Rockefeller
Foundation, etc)
Next Steps: LM&E and SDI
• Movement of urban poor, SDI, re-thinking methodologies & supporting rituals for LM&E on a global/secretariat level
• Need to contribute SDI approach to professional/academic evaluation community, for comparative enriching
• Ghana NGO and social movement in discussion with IPA on development of localized M&E framework
• Grantees, such as Rockefeller Foundation exploring opportunities with evaluation institutions
ABOUT AUTHOR &
ACKNOWLEDGEMENTS • Author -- Dr. Sulley Gariba is a monitoring and
evaluation specialist and consultant, with over 25 years of experience in participatory M&E, policy analysis and management of poverty reduction initiatives. He is head of a policy think-tank in Ghana, the Institute for Policy Alternatives (IPA-Ghana)
• Original work and production of this paper involved: Jack Macau of the Slum Dwellers International Secretariat, Irene Karanja of the Kenya-based Mungano Support Trust, and Suman Sureshbabu of the Rockefeller Foundation.
Dr. Sulley Gariba is a monitoring and evaluation
specialist and consultant, with over 25 years of
experience in participatory M&E, policy analysis and
management of poverty reduction initiatives. He is
head of a policy think-tank in Ghana, the Institute for
Policy Alternatives (IPA-Ghana)
Questions and Answers
Stewart Donaldson, Dean & Chair of Psychology
School of Behavioral & Organizational Sciences,
Claremont Graduate University
MODERATOR
Audience Questions
Wrap-up
Penny Hawkins, Rockefeller Foundation Evaluation
Office, is the former Head of Evaluation for the New
Zealand Aid Program, Ministry of Foreign Affairs and
Trade and Vice-Chair of the OECD-DAC Network on
Development Evaluation. She is a past President of the
Australasian Evaluation Society, a founding board
member of the International Organization for Cooperation
in Evaluation (IOCE) and an IPDET (International
Program for Development Evaluation Training) faculty
member.
What’s New!
Introductory e-learning on:
DEVELOPMENT EVALUATIONS
Available at http://mymande.org/elearning
The instructors are 33 world-level specialists
• International experts, including Michael Quinn Patton, Michael
Bamberger, Jim Rugh, David Fetterman, Patricia Rogers,
Stewart Donaldson, Donna Mertens, Jennifer Greene, Bob
Williams, Martin Reynolds, Saville Kushner and Hallie Preskill
• Senior representatives of the international community,
including Caroline Heider, Belen Sanz, Indran Naidoo, Fred
Carden, Hans Lundgren, and Marco Segone
• Senior managers responsible for country-led M&E systems,
including Sivagnanasothy Velayuthan and Diego Dorado
• Leaders from the Global South and BRIC countries, including
Zenda Ofir, Shiva Kumar and Alexey Kuzmin
How to register in e-Learning courses
How to register in e-Learning courses
Evaluation of Webinars
Survey
Your opinion/feedback is important to us, therefore
we ask that you complete this short evaluation on
today’s webinar.
http://6.28.2012.questionpro.com