florence kondylis & mattea stein development impact evaluation initiative
TRANSCRIPT
DIME-GAP Collaboration: Concretely, what are we going to learn?
Florence Kondylis & Mattea Stein
Development Impact Evaluation Initiative
Stock-taking
Agriculture & Local Development: AADAPT launched in Africa, Apr 2009
Since then, launched in 2 more regions Over 40 ongoing impact evaluations
Finance & Private Sector Development: DIME FPD Global launched, Dec 2010
22 ongoing impact evaluations across 4 regions
What work has been done? What are we going to learn?
Outline
3600 tour of DIME-GAP collaboration and ongoing work in both sectors
Detailed project-specific learning plans: Irrigation management in Mozambique Trust and reputation for SMMEs’ market
expansion in RSA
Overview: Agriculture & Local Development
Technology Adoption
Ethiopia- Improved Coffee &
Poultry varieties: Who adopts, and to what
effect?- Farmers innovation
funds: identification and adoption
Tanzania- What’s the impact of partly
relaxing the financial constraint on fertilizer
adoption? - What targeting mechanisms
are best at reaching the intended participants?
Irrigation & Water
GovernanceEthiopia
- What fee collection mechanisms work best?- What’s the impact on the Quality & Quantity
of water used domestically?
Tamil Nadu (India)- What is better water
management?- What incentives best encourage farmers to
adopt “good” management practices?
Farmers’ Groups
Andhra Pradesh (AP)- How can we best
encourage the rural poor to build their own institutions to improve their livelihoods and quality of life (health,
credit, and agricultural interventions)?
Brazil: “Productive Projects”
(Cearà, Recife, Paraiba)
- CDD: What’s the relative effect of proposal facilitation alone
/facilitation + subsidy?
How do we make irrigation sustainable and market-led?
Small-scale irrigation project in Mozambique Not a typical brick-and-mortar project.
Government is asking: How can farmers best manage their irrigation schemes? How to ensure that farmers get high returns?
Interventions of particular interest Market information; Production coordination
(horticulture +); Irrigation Organization formation
Exploit the development path of the project to test each intervention individually and inform implementation on the go (gradual scale-up)
Years 1/2
Mozambique Irrigation: Impact Evaluation Design
Project Area
Market Information 1
Coordination Intervention
Women Head of IO
Regular IO
No Coordination
Women Head of IO
Regular IO
Market Information 2
Coordination Intervention
Women Head of IO
Regular IO
No Coordination
Women Head of IO
Regular IO
Years 2/3 Years 4/5
Years 1/2
Mozambique Irrigation: Impact Evaluation Design
Project Area
Market Information 1
Coordination Intervention
Women Head of IO
Regular IO
No Coordination
Women Head of IO
Regular IO
Market Information 2
Coordination Intervention
Women Head of IO
Regular IO
No Coordination
Women Head of IO
Regular IO
Years 2/3 Years 4/5
Years 1/2
Mozambique Irrigation: Impact Evaluation Design
Project Area
Market Information 1
Coordination Intervention
Women Head of IO
Regular IO
No Coordination
Women Head of IO
Regular IO
Market Information 2
Coordination Intervention
Women Head of IO
Regular IO
No Coordination
Women Head of IO
Regular IO
Years 2/3 Years 4/5
Years 1/2
Mozambique Irrigation: Impact Evaluation Design
Project Area
Market Information 1
Coordination Intervention
Women Head of IO
Regular IO
No Coordination
Women Head of IO
Regular IO
Market Information 2
Coordination Intervention
Women Head of IO
Regular IO
No Coordination
Women Head of IO
Regular IO
Years 2/3 Years 4/5
Overview: What are we going to learn in FPD? (1)
Access to Finance
Cape Verde- Can a
matching grant program relieve
the financial constraints
faced by SMEs, especially
those owned by women?
Financial Literacy
Training/Skills
Development
Uganda- Can skills
development training for small scale
industries improve worker efficiency,
product quality and sales?
- Does it help firms expand from local to
regional markets?- Does it increase
women’s participation in artisanship?
Overview: What are we going to learn in FPD? (2)
Networks/ Information
South Africa- See NEXT:
detailed example…
Institutional Environmen
tSenegal-Does the
computerization of court case entry
improve the efficiency and transparency of the court decision
process?- What is the impact on firms’ perception
of the justice system, and on their
investment decisions?
Cross-country LearningShaping the policy
agenda- Study market failures
that constrain the growth potential of the private sector: access
to finance, market information,
reputation, business environment, skills
supply & demand, …- What is their relative
importance, that is, which present the
most binding constraints for SMEs?
Building a Record: Trust and Reputation for SMMEs’ Market Expansion in RSA
In South Africa, “closed” business networks impose large constraints on Small, Micro and Medium Enterprises (SMMEs) For their supply, Large Enterprises (LEs) rely on an “Old boy club”
of LEs LEs dominate LEs’ supply chain
Lack of network membership presents a barrier-to-entry for SMMEs▪ No record, no reputation, do not inspire trust >> No network entry >> No
market access
LEs could internalize the risk associated with SMMEs’ lack of reputation (price discrimination)▪ In the absence of a directory, very costly for LEs to search and screen
potential suppliers among SMMEs
Some groups are particularly disadvantaged Gender, Race, and Age-based discrimination Despite preferential procurement policies (e.g. Black Economic
Empowerment initiative)
SMEs’ Market Expansion in RSA: Interventions and Identification Strategy
The government proposes to create a virtual “marketplace” for SMMEs 1. Directory of SMMEs
▪ By size, location, sector
▪ Online and accessible through SMS queries
2. Reputation & Track Record Existing business history, relationships & Performance rating system
Reduce LEs’ search costs? Reduce LEs’ screening costs?
Improve SMMEs’ market access and customer base?
Random assignment to Directory Directory + Reputation & Track Record
Measure relative impact by gender, race and age power calculations to ensure measurability
RSA SMEs’ Market Expansion: Impact Evaluation Design (by gender)
Target Population:SMMEs in KwaZulu Natal province
Pilot Sample::3,000 SMMEs
Women-owned SMMEs1,000 SMMEs
Directory(500 SMMEs)
Directory+ Reputation & Track Record
(500 SMMEs)
Men-owned SMMEs2,000 SMMEs
Directory(1,000 SMMEs)
Directory+ Reputation & Track Record
(1,000 SMMEs)
RSA SMEs’ Market Expansion: Impact Evaluation Design (by gender)
Target Population:SMMEs in KwaZulu Natal province
Pilot Sample::3,000 SMMEs
Women-owned SMMEs1,000 SMMEs
Directory(500 SMMEs)
Directory+ Reputation & Track Record
(500 SMMEs)
Men-owned SMMEs2,000 SMMEs
Directory(1,000 SMMEs)
Directory+ Reputation & Track Record
(1,000 SMMEs)
RSA SMEs’ Market Expansion: Impact Evaluation Design (by gender)
Target Population:SMMEs in KwaZulu Natal province
Pilot Sample::3,000 SMMEs
Women-owned SMMEs1,000 SMMEs
Directory(500 SMMEs)
Directory+ Reputation & Track Record
(500 SMMEs)
Men-owned SMMEs2,000 SMMEs
Directory(1,000 SMMEs)
Directory+ Reputation & Track Record
(1,000 SMMEs)
Implications
DIME-GAP works with governments to identify their key learning priorities and support them in getting answers in real time to move their agenda forward Work to place gender a the center of the policy debate▪ Integrate gender into causal chains
▪ Think of gender-sensitive interventions
Bring best technical advice on how to measure gender-disaggregated results▪ Power calculations & Survey instruments that get to the answers
Building and disseminating rigorous evidence on the relative impact of interventions by gender Big step towards making gender equality smart economics
Coordination & Research: Contacts
Radu Ban, DIME
Elena Bardesi, PRMGE
Isabel Beltran, DIME
Rui Manuel Benfica, PRMGE
Alaka Holla, AFTPM
Florence Kondylis, DIME
Nandini Krishnan, AFTRL (AIM)
Mattea Stein, AFTRL (AIM)
Abdoulaye Sy, LCSSD
LSMS Team, DECRG
Large team of external research partners
JPAL, IPA, Yale, UC Berkeley, MIT, Harvard, UMD, etc
Local universities & research centers
Thank You
How do we make demonstration plots work?
Government of Malawi wants to promote “conservation agriculture” (pit planting)
more efficient/responsible fertilizer use
among maize farmers They are asking:
What are the effective strategies to communicate about new technologies with farmers?
How to boost technology adoption?
Malawi Technology Adoption: Impact Evaluation Design
Target population(villages)
Extension Agents
Performance-based incentives
No incentive
Lead Farmer(1/2 men,½ women)
Performance-based incentives
No incentive
Peer Farmers(1/2 men,½ women)
Performance-based incentives
No incentive
Malawi Technology Adoption: Impact Evaluation Design
Target population(villages)
Extension Agents
Performance-based incentives
No incentive
Lead Farmer(1/2 men,½ women)
Performance-based incentives
No incentive
Peer Farmers(1/2 men,½ women)
Performance-based incentives
No incentive
Malawi Technology Adoption: Impact Evaluation Design
Target population(villages)
Extension Agents
Performance-based incentives
No incentive
Lead Farmer(1/2 men,½ women)
Performance-based incentives
No incentive
Peer Farmers(1/2 men,½ women)
Performance-based incentives
No incentive