defining and measuring the social impact of clean cooking solutions march 16, 2015

Defining and Measuring the Social Impact of Clean Cooking Solutions

March 16, 2015

What we will cover today:

1. The objectives & purpose of creating a global measurement system

2. The process of developing the conceptual frameworks & draft indicators

3. Conceptual frameworks→ Feedback

4. Draft indicators & measurement methodologies→ Feedback

5. Next steps

Social Impact M&E Needed at Three Levels

1) Social impact conceptual framework for the sector overall – telling a global story • What information do we want from all partners to demonstrate the sector has a social

impact? • Suggestions include economic status of household/poverty reduction, time savings,

livelihoods created. • Potentially utilize Progress out of Poverty Index for poverty measurements.

2) Social impact M&E indicators, methodologies, and tools to measure and track a limited number of social impact areas at the enterprise/project level.

• Set of indicators & methodologies • Guidance for implementation • Results reporting and certification

3) Strategy for M&E deep dive impact evaluations in certain areas. • Areas where specific impact evaluations are needed to fill data gaps and get a more robust

picture. For example, the Alliance research studies looking at impact of adoption on households in areas of empowerment, time savings, education, decision-making, etc.

Process for Defining, Measuring and Reporting on Social Impact

• Objectives:– Gain consensus on the main domains and pathways through which the clean cooking

sector creates social impact– Create a collection of standardized indicators & measurement methodologies– Create a centralized data capture, management, and analysis system

• Why?– To allow partners to track and analyze progress– To aggregate the social impact of the clean cooking sector at a global level

• How?

– Map and define relevant social impacts– Select key domains of social impact for measurement– Draft indicators– Select/create measurement methodologies – Field test indicators and measurement methodologies– Develop a data capture and management system– Pilot M&E system– Modify and adjust– Roll out

Have completed this phase

Current phase

Why ICRW wanted to engage in this work:

• Women are often the hardest hit by lack of access to clean cooking solutions

• Yet there is little evidence of how women and their families experience social and economic advancement and empowerment:– through women’s engagement throughout clean cooking value chains– through adoption of clean cooking solutions

• Critical to build this evidence base around social and economic impacts of clean cooking solutions

Process for Creating Conceptual Frameworks & Draft Indicators:

• Conducted background literature review & interviews with key experts– Energy, gender & energy, sustainable livelihoods, gendered value chains,

women’s economic empowerment, cookstove adoption, time poverty, drudgery, productive use of cookstoves, GBV associated with fuel collection, etc.

– Measurement systems, indicator development

• Held a convening with the Social Impact Working Group (now re-named the Social Impact Steering Committee to avoid confusion with ISO process)– Experts in energy, livelihoods, gender– Clean energy enterprises– Clean cooking researchers & implementers– Impact investors– Measurement system creation & execution

• Collaborated with the ISO process

Pathways of Social Impact

• PATHWAY 1: How involvement in the clean cooking value chain expands livelihoods opportunities for women and men– How involvement of women in the clean cooking

value chain enhances women’s social and economic empowerment

• PATHWAY 2: How adoption of clean cooking solutions translates into improvements in households’ social & economic well-being

Social Impact Conceptual Framework- PATHWAY 1: How involvement in the clean cooking value chain expands livelihoods opportunities for women and men

EmploymentInvestors

Production of clean fuels and/or stoves

Distribution of clean fuels and/or stoves

Business & social networks

Technical & business skills

Income

Knowledge of environmental/ health

benefits

Borrowers (supply-side)

Quality employment and/ or entrepreneurship opportunities

Increased income

Increased knowledge & skills

Increased access to resources

Enhanced social capital through expanded networks

Adoption of clean cooking

solutions

After-sales service of clean stoves

Involvement through the Clean Cooking

Value Chain

Selection & design of clean cooking products

Components of Enhanced

Livelihoods

Outcomes of Expanded Livelihood

Opportunities

SME owners & executives

Financing options for consumers

Expanded access to capital/credit

Enhanced economic well-being

Ultimate Goal

Source: ICRW (2011). Understanding and Measuring Women’s Economic Empowerment: Definition, Framework and Indicators. Graph: MarketShare Associates (2014)

Safety

Voice

Women’s Economic Empowerment

Relations

Structures & Institutions

Health

Defining WEE

A woman is economically empowered when she has both the ability:

• To succeed and advance economically– women need the skills and resources to compete in

markets, as well as fair and equal access to economic institutions

• To have the power and agency to benefit from economic activities– women need to have the ability to make and act on

decisions and control resources and profits

Measuring Women’s Economic Empowerment

Social Impact Conceptual Framework- PATHWAY 1: How involvement of women in the clean cooking value chain enhances women’s social and economic empowerment

EmploymentWomen investors

Women in production of clean fuels and/or stoves

Women in distribution of clean fuels and/or stoves



Income


benefits

Expanded access to capital/credit Women as borrowers

(supply-side)

Enhanced voice/ participation

Improved self-confidence & self-efficacy

Increased decision-making and control over resources

Improved status


solutions

Women in after-sales service of clean stoves

Agency

Involvement of Women

Women in selection & design of clean cooking

products

Components of Empowerment

Outcomes of Empowerment

Women SME owners & executives

Mul

tiplie

r E

ffec

t

Financing options targeted to women as

consumers

Women’s enhanced social &

economic empowerment

Ultimate Goal

Social Impact Conceptual Framework- PATHWAY 2: How adoption of clean cooking solutions translates into improvements in households’ social & economic well-being


solutions Increased time spent on leisure activities

Time spent cooking

Increased time spent on income- generating activities

Increased time spent on education/ training

(adult/children)

Shifts in Household Finances

Enhanced social and economic

well-being

Health benefits

Time spent collecting fuel

Money spent on fuel

Money earned using clean cookstove/fuel

Secondary Outcomes

Primary Outcomes

Ultimate Outcomes

Reduced drudgery (time & heaviness of load)

Enhanced safety/protection (reduced exposure to potential injury, GBV)

Increased financial security/income

Length/frequency of fuel collecting trips

Increased time spent on informal, non-income generating activities

Health benefits (reduced smoke exposure,

lower rates of accidents/burns)

Shifts in Time Use

Shifts in Workload

FEEDBACK?

EmploymentInvestors

Production of clean fuels and/or stoves

Distribution of clean fuels and/or stoves



Income


benefits

Borrowers (supply-side)

Quality employment and/ or entrepreneurship opportunities

Increased income

Increased knowledge & skills

Increased access to resources

Enhanced social capital through expanded networks


solutions

After-sales service of clean stoves

Involvement through the Clean Cooking

Value Chain

Selection & design of clean cooking products

Components of Enhanced

Livelihoods

Outcomes of Expanded Livelihood

Opportunities

SME owners & executives

Financing options for consumers

Expanded access to capital/credit

Enhanced economic well-being

Ultimate Goal

FEEDBACK?

EmploymentWomen investors

Women in production of clean fuels and/or stoves

Women in distribution of clean fuels and/or stoves



Income


benefits

Expanded access to capital/credit Women as borrowers

(supply-side)

Enhanced voice/ participation

Improved self-confidence & self-efficacy

Increased decision-making and control over resources

Improved status


solutions

Women in after-sales service of clean stoves

Agency

Involvement of Women

Women in selection & design of clean cooking

products

Components of Empowerment

Outcomes of Empowerment

Women SME owners & executives

Mul

tiplie

r E

ffec

t

Financing options targeted to women as

consumers

Women’s enhanced social &

economic empowerment

Ultimate Goal

FEEDBACK?


solutions Increased time spent on leisure activities

Time spent cooking

Increased time spent on income- generating activities

Increased time spent on education/ training

(adult/children)

Shifts in Household Finances

Enhanced social and economic

well-being

Health benefits

Time spent collecting fuel

Money spent on fuel

Money earned using clean cookstove/fuel

Secondary Outcomes

Primary Outcomes

Ultimate Outcomes

Reduced drudgery (time & heaviness of load)

Enhanced safety/protection (reduced exposure to potential injury, GBV)

Increased financial security/income

Length/frequency of fuel collecting trips

Increased time spent on informal, non-income generating activities

Health benefits (reduced smoke exposure,

lower rates of accidents/burns)

Shifts in Time Use

Shifts in Workload

Domains of ImpactPathway 1

Pathway 2Domains of impact

Full-time/ part-timePermanent/ temporaryManagement levelArea within the value chainGeographic locationWomen-owned

Decision-making & control over resources/ assetsSelf-confidence/ self-efficacy

Key areas of measurement

Agency

Live

lihoo

ds

Business skillsEmpowerment/leadership skillsAccess to networksAccess to credit

JobsIncome non-management staff (full-time/ part-time) or permanent/annual & temporary/seasonalIncome management staffQuality of jobs created

Interaction with external organizations and entrepreneursMentoring

Domains of impact

Safety/protectionDrudgery


Hous

ehol

d So

cial

& E

cono

mic

W

ell-b

eing

Well-beingStatus within the family/communityWorkload

Hous

ehol

d Fi

nanc

es

Money spent on fuelIncome through productive use of cookstoveEconomic stability

Tim

e U

se Time spent on fuel collectionTime spent on cooking

Pathway 1: How Involvement in the clean cooking value chain expands livelihood opportunities Domains

of impact




Agency

Live

lihoo

ds




Income Domains of impact

Live

lihoo

ds

Income (management employees)

Average income of female management employees

Average income of male management employees

Key areas of measurement IndicatorIncome full-time/ part-time (non-management employees)

or Permanent/annual & temporary/ seasonal

Average income of female full-time employees (non-management)

Average income of male full-time employees (non-management)

Average income of female part-time employees (non-management)Average income of male part-time employees (non-management)

AgencyDomains of impact

Average level of satisfaction with ability to make business expenditure decisions(disaggregated by males/females)

Average level of satisfaction with ability to make decisions about household expenditures(disaggregated by males/females)

Live

lihoo

ds

OPTION 1: Average sense of autonomy felt by employees/ entrepreneurs(disaggregated by males/females)OPTION 2: Average sense of agency (i.e. goal-directed energy) among employees/ entrepreneurs(disaggregated by males/females)

Key areas of measurement Indicator

Average level of satisfaction with ability to make important life decisions

Percentage of respondents who have recently participated in business

Percentage of respondents who have recently participated in household

OPTION 2: Average sense of knowing the pathway to accomplishing one's goal among employees/ entrepreneurs(disaggregated by males/females)

AgencyDecision-making & control over resources/ assets

Self-confidence/ self-efficacy

Pathway 2: How adoption of clean cooking solutions translates into improvements in households’ social & economic well-being

Domains of impact

Safety/protectionDrudgeryHo

useh

old

Soci

al &

Eco

nom

ic

Wel

l-bei

ng


Hous

ehol

d Fi

nanc

esMoney spent on fuelIncome through productive use of cookstoveEconomic stability

Tim

e U



Household Finances

Domains of impact

Total change in amount of money spent on fuel in households that adopt clean cooking solutionsPercentage of those using the cookstove for income generation who are female

Average income earned by females using the cookstove for income generation


Hous

ehol

d Fi

nanc

es

Money spent on fuel Average change in money spent on fuel per household that obtains new clean cooking solutions technology/units

Income through productive use of cookstove

Percentage of consumers who are using the cookstove for income generation

Average income earned by those using the cookstove for income generation

Economic stability OPTION 1: Percentage of people who report a positive change in their level of satisfaction with their standard of living(disaggregated by males/females)

OPTION 2: Percentage of people who report improvements in their perception of economic stability(disaggregated by males/females)

Time use

Domains of impact

Total change in number of hours spent on fuel collection (per household and/or disaggregated by men, women, boys, girls)

Total change in number of hours spent on cooking (per household and/or disaggregated by men, women, boys, girls)


Tim

e U

se

Time spent on fuel collection

Average change in number of hours spent on fuel collection (per household and/or disaggregated by men, women, boys, girls)

Time spent on cooking

Average change in number of hours spent on cooking (per household and/or disaggregated by men, women, boys, girls)

Household Social & Economic Well-being Domains of impact

Average change in satisfaction score(disaggregated by males/females)

Hous

ehol

d So

cial

& E

cono

mic

Wel

l-bei

ng

Well-being OPTION 1: Percentage of people who perceive a positive change in their well-being after using the clean cooking solutions(disaggregated by males/females)OPTION 2: Percentage of people who experienced a positive change in overall satisfaction score.(disaggregated by males/females)

Status within the family/community

OPTION 1: Percentage of people who report a positive change in their perception of their own status within the family/ community(disaggregated by males/females)OPTION 2: Percentage of people who experienced a positive change in their level of satisfaction with their status in their family and community(disaggregated by males/females)

Workload

Drudgery OPTION 1: Percentage of people who report a positive change in their perception of their level of drudgery/workload(disaggregated by males/females)

Safety/protection

OPTION 1: Percentage of people who report a positive change in their perception of their exposure to risk(disaggregated by males/females)OPTION 2: Percentage of people who experience a positive change in their level of satisfaction with their sense of safety in their community(disaggregated by males/females)

OPTION 2: Percentage of people who experienced a positive change in their level of satisfaction with their level of drudgery/workload(disaggregated by males/females)


FEEDBACK?Pathway 1

Pathway 2Domains of impact




Agency

Live

lihoo

ds




Domains of impact

Safety/protectionDrudgery


Hous

ehol

d So

cial

& E

cono

mic

W

ell-b

eing


Hous

ehol

d Fi

nanc

es

Money spent on fuelIncome through productive use of cookstoveEconomic stability

Tim

e U


Next Steps

• Incorporate feedback and revise conceptual frameworks and draft indicators– [email protected]

• Field test indicators and measurement methodologies

• Develop data capture & management systems

• Pilot M&E system

• Modify and adjust

• Roll out

defining and measuring the social impact of clean cooking solutions march 16, 2015

Documents

social impact objectives

impact of adoption

key domains of social

social impact working

clean cooking sector

relevant social impacts

specific impact evaluations

clean cooking value