individual-disaggregated questionnaire design & data in lsms-isa: too many shades of grey?

29
Individual-Disaggregated Questionnaire Design & Data in LSMS-ISA: Too Many Shades of Grey? Talip Kilic Living Standards Measurement Study Team Poverty & Inequality Group Development Research Group The World Bank Presented at the 3rd annual Living Standards Measurement Study – Integrated Surveys on Agriculture (LSMS-ISA) project workshop at Zanzibar Beach Resort Hotel, Zanzibar, Tanzania, February 13-14, 2012

Upload: halen

Post on 07-Feb-2016

36 views

Category:

Documents


0 download

DESCRIPTION

Individual-Disaggregated Questionnaire Design & Data in LSMS-ISA: Too Many Shades of Grey?. Talip Kilic Living Standards Measurement Study Team Poverty & Inequality Group Development Research Group The World Bank. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Individual-Disaggregated Questionnaire Design & Data in LSMS-ISA: Too Many Shades of Grey?Talip KilicLiving Standards Measurement Study TeamPoverty & Inequality Group Development Research GroupThe World BankPresented at the 3rd annual Living Standards Measurement Study – Integrated Surveys on Agriculture (LSMS-ISA) project workshop at Zanzibar Beach Resort Hotel, Zanzibar, Tanzania, February 13-14, 2012

Page 2: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

“While a great deal has been learned about what works and what does not when it comes to promoting greater gender equality, the truth remains that progress is often held back by the lack of data…”

World Bank World Development Report 2012 Gender Equality and Development

Page 3: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Why Collect Individual-Disaggregated Data?• Analysis of welfare or productivity at the individual-level can signal whether there is a need for interventions targeted to specific groups or individuals within households• Analysis of intra-household resource allocation through individual-disaggregated data important for setting strategic priorities & understanding how policy interventions affect household members differently • Certain phenomena, such as gender equality in a given economic or social dimension, can be appropriately analyzed only if individual-level data are available

Page 4: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Motivational Insights from the WDR 2012• Effective domestic public action to bring about gender equality “sometimes hinges on the production of a public good, such as the generation of new (global) information or knowledge”• Better & widely available gender-disaggregated data & comprehensive gender diagnostics crucial for evidence-based public action• Need for country-specific diagnostic studies also driven by cross-country variations in the nature of markets, institutions & social norms

Page 5: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

How can LSMS-ISA help?• Nationally-representative• Multi-country, high-degree of heterogeneity in the nature of markets, institutions & social norms across project countries• Panel survey design• Multi-topic framework with a strong focus on agriculture, where the availability & quality of individual disaggregated data are particularly poor• LSMS traditionally focused on individual/gender-disaggregated data collection, as also reflected in the current set of LSMS-ISA instrumentsYet…• Review of LSMS-ISA questionnaires & available data highlight several areas that could be improved & standardized across countries at a relatively low cost to enable richer analyses of intra-household resource allocation & gender-disaggregated outcomes

Page 6: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Paving the Path for Collecting More Comprehensive & Standardized Individual-Disaggregated Data• Agriculture– Ownership, Management vs. Control, Extension

• Livestock• Wage Employment• Non-Farm Self Employment• Social Assistance• Remittances• Other Income• Durable Asset Ownership

Page 7: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Qx Review: Agriculture –OwnershipKey Question Level of Obs. ET MW NIGERIA TZ UGWho in the household owns [PARCEL/PLOT]? (Owned Plots)

Parcel/ Plot

YES* YES (Up to 2) YES(Only 1) YES (Up to 2) YES (Up to 2)Who in the household has the use rights to [PARCEL/PLOT]? (Rented Plots) NO NO NO NO YES (Up to 2)Who else (besides the owner) in the household has the right to sell [PLOT] or use it as collateral?NO NO YES(Up to 3) NO NO

Who in the household owns [ITEM]? Farm Implement NO NO YES(Only 1) NO NO* Information solicited only if parcel has a certificate.

Page 8: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Qx Review: Agriculture –ManagementKey Question Level of Obs. ET MW NIGERIA TZ UGWho in the household makes the decisions concerning crops to be planted, input use and the timing of cropping activities on [PLOT]? Plot/ Field

YES (Up to 2) YES(Only 1) YES(Only 1) YES***(Up to 3) YES** (Up to 2)Who in the household are other decision makers on [PLOT]? N/A N/A YES (Up to 4) N/A N/A

** Determine joint vs. sole decision making, then solicit information accordingly.

*** Who decided what to plant on [PLOT]?

Page 9: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Qx Review: Agriculture - ControlKey Question Level of Obs. ET MW NIGERIA TZ UGWho in the household makes the decision concerning the use of the [CROP] output from [PLOT]? Plot-Crop NO NO NO NO YES** (Up to 2)Who in the household kept/decided on the use of/controlled earnings from sales of [CROP]? Crop YES (Up to 2) YES (Up to 2) YES (Up to 2) YES (Up to 2) YES**** (Up to 2)Who in the household kept/decided on the use of earnings from sales of [CROP]?

Tree/ Permanent/ Root Crop NO YES (Up to 2) NO NO YES**** (Up to 2)** Determine joint vs. sole decision making, then solicit information accordingly.

**** Information collected at the parcel-plot-crop-level.

Page 10: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Qx Review: Agriculture - ExtensionKey Question Level of Obs. ET MW NIGERIA TZ UGWho in the household received advice from [SOURCE]? Extension Source YES(Holder) Yes (Up to 4) Yes (Up to 4) NO Yes (Up to 4)

Page 11: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Qx Review: LivestockKey Question Level of Obs. ET MW NIGERIA TZ UGWho in the household owns [LIVESTOCK]? Animal Type

YES(Holder) YES (Up to 2) YES (Up to 2) NO YES (Up to 2)Who in the household is responsible for keeping/feeding/taking care of [LIVESTOCK]? NO YES (Up to 2) YES (Up to 2) YES (Up to 2) YES (Up to 2)Who in the household kept/decided on the use of earnings from sales of [PRODUCT]? Livestock Product NO YES (Up to 2) NO YES (Up to 2) YES (Up to 2)

Page 12: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Qx Review: Wage EmploymentKey Question Level of Obs. ET MW NIGERIA TZ UGWho in the household controls/decides on the use of last payment/salary? (Separately for main, secondary & casual activities)

Individual NO NO NO NO NO

Page 13: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Qx Review: Non-Farm Self-EmploymentKey Question Level of Obs. ET MW NIGERIA TZ UGWho in the household manages [ENTERPRISE] or is most familiar with it? Enterprise

NO YES(Up to 2) YES(Up to 2) YES OWNER = MANAGERWho in the household owns/owned [ENTERPRISE]? YES(Up to 2) YES(Up to 2) YES(Up to 2) YES(Up to 2)Who in the household works in [ENTERPRISE]? YES(Up to 5) YES (Up to 4) YES(ALL) NO YES(Up to 5)

Page 14: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Qx Review: Social AssistanceKey Question Level of Obs. ET MW NIGERIA TZ UGWho in the household received assistance from [PROGRAM]? Program Type

YES(Up to 3) YES(Up to 5) YES(Up to 5) YES(Up to 3) NO MODULEWho in the household controls/decides on the use of assistance from [PROGRAM]? (IF APPLICABLE) NO YES(Up to 2) NO NO

Page 15: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Qx Review: RemittancesKey Question Level of Obs. ET MW NIGERIA TZ UGWho in the household kept/decided on the use of [INCOME]? Various YES(Up to 2) NO** NO*** NO** NO

Other IncomeKey Question Level of Obs. ET MW NIGERIA TZ UGWho in the household kept/decided on the use of [INCOME]? Other Income Type YES(Up to 2) YES(Up to 2) NO NO MODULE NO

** Level of Obs: Remitting-individual in 2008/09; No Module in 2010/11*** Level of Obs: Recipient

Page 16: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Qx Review: Durable Asset OwnershipKey Question Level of Obs. ET MW NIGERIA TZ UGWho in the household owns [ASSET]? Durable Asset YES(Up to 2) NO YES(Only 1) NO NO

Page 17: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Building a Case…• … for collecting more comprehensive information on intra-household resource allocation in a standardized fashion across LSMS-ISA instruments

Page 18: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Case Study # 1• We revisit the link between woman’s control of income & child nutrition using data from the Malawi IHS3

– Estimate the impact of woman’s share of household income on height-for-age z-scores for boys 6-59 months of age relative to girls in the same cohort• The primary shortcomings of the existing studies are that they either

– focus on a specific component of HH income OR – compute a total HH income aggregate but assign the control of income among individuals based on questionable assumptions

• Contrast our results with those that would be obtained by assigning control of income among household members based on assumptions that are commonly found in the literature

Page 19: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Data• Malawi Third Integrated Household Survey (2010/11)• Sample: 2,522 Children (6-59 Months)

– Biologically implausible/potentially outlier z-scores excluded– Of Malawian couples with multiple children (household fixed-effects)

• Definitions of woman’s share of household total income– V1: Each income component, w/the exception of wage employment, assigned 100% to HH Head; wage income assigned to earners– V2: Each income component, w/the exception of wage employment, split 50/50 between head & spouse; wage income assigned to earners– V3: Replication of the approach of Haddad & Hoddinott (HH), 1994; 1995– V4: Preferred definition that incorporates available ownership/control info

• Current income definition excludes livestock & fishery net revenues• Farm self-employment income = Aggregated plot-level net revenues

Page 20: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Methodology• Linear regression with household fixed-effects, controlling for time-invariant unobservable household heterogeneityyih = c0 + µ Maleih +γ FSI*Maleih + β Childih+ ρParentalih + νh + ξih• i & h Denote child & household, respectively• yih Z-score of height for age• c0 Constant• Male Dummy variable identifying male child• FSI*Male Woman’s share of household income interacted with Male• Child Vector of child age & birth order categories• Parental Vector of parental characteristics• ν Household fixed-effects• ξ Error term

Page 21: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Selected Regression ResultsDependent Variable: Z-Score of Height-for-Age

Definitions of Woman’s Share of Household Income V1Assumption100 to Head V2Assumption50/50 Split

V3 Assumption a la HH V4 Preferred

Child: Male -0.130 -0.129 -0.147 -0.186**Woman's Share of Household Income x Male Child -0.735 -0.070 -0.008 0.155***Observations 2,522 2,522 2,522 2,522R2 0.711 0.710 0.710 0.711note: *** p<0.01, ** p<0.05, * p<0.1

Page 22: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Case Study # 2 • We revisit the evidence on gender differences in agricultural productivity in sub-Saharan Africa (SSA) by using detailed plot-level agricultural data collected within a multi-topic framework as part of the Malawi IHS3• In targeting sustainable poverty gains through smallholder-based agricultural growth, national development plans have emphasized the alleviation of gender differences in agricultural productivity• Increased productivity among female farmers argued to result in: (i) poverty alleviation through positive impact on overall smallholder productivity growth, & (ii) improvement of nutritional outcomes

Page 23: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Shortcomings of Current Literature on Gender Differences in Agricultural Productivity in SSAHousehold-Level Analyses• Data do not identify plot managers within households• Main explanatory variable: Gender of head of household• Concerns regarding the plausibility of assumptions in sub-Saharan African settings

Plot-Level Analyses• Plot-level outcomes linked to managers/owners• Cohabitation of male & female managers/owners allows for estimation of within-household differencesHowever…• Rich agricultural data often not solicited in multi-topic framework• External validity concerns: Small/non-representative samples• Can management & ownership be used interchangeably?

Page 24: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Methodologyln(Yih)= c0 + β Femaleih + µ Mih +γ Pih + ρln(Iih )+ δln(Lh )+ νh + ξih• i & h denote agricultural plot & household, respectively; • Y – KGs of maize production/ha;• Female

– identifies a plot managed by a female in Specification 1.– is replaced in Specification 2 with two indicator variables identifying (i) exclusively female owned, and (ii) mixed male & female owned plots. The comparison category is exclusively male owned plots.

• M – vector of variables on other characteristics of the plot manager;• P – vector of variables plot physical characteristics; • I – vector of variables capturing the extent of non-labor input use;• L – vector of variables capturing household & hired labor input; • ν – household fixed-effects;

– Only plots from HH cultivating multiple maize plots inform the estimates• ε & c0 – the error and constant term, respectively. […]

Page 25: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Plot Owners & Managers: Overlap vs. DiscrepancyCategories Freq. ShareSolely Owned (SO)    Owner & Manager Overlap 8,827 63.3Owner & Manager Discrepancy 3,139 21.9Jointly Owned (JO)    Owner & Manager Overlap 2,824 14.7Owner & Manager Discrepancy 11 0.1TOTAL 14,801 100.0[…]

Page 26: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Selected Regression ResultsDependent Variable: Log of Maize Production (KG)/Ha

Specification 1 Specification 2 All Plots Owned PlotsPlot Management: Female -0.190** --  (0.076)  Plot Ownership: Exclusively Female -- -0.117*    (0.060)Plot Ownership: Mixed - Male & Female -- 0.130    (0.118)Observations 6,061 4,176note: *** p<0.01, ** p<0.05, * p<0.1

Page 27: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Conclusions• Management is not synonymous with ownership• Extent of data collection on intra-household allocation of resources in LSMS-ISA instruments encouraging but not all-encompassing• Modules allowing for the computation of a total household income aggregate largely exist, however unevenness persists in terms of whether individuals that keep/decide on the use of earnings from different sources are identified• Within existing structures, benefits likely to considerably outweigh the costs of including an additional question identifying individuals that decide on the use of earnings from each possible source

Page 28: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Topics for Discussion• Reactions? • Lingering differences in the way that plot managers are identified (wording, single vs. joint-management, etc…): Easy fix?• To complement information on parcel owners & plot managers, Uganda is the only country that identifies (up to 2) individuals that

– hold use rights to parcels that are rented in (parcel-level)– decide on the use of the crop output (parcel-plot-crop-level)

• Unevenness across questionnaires in terms of the availability of module(s) on other income receipts• Convenient to assume wage income is in the control of earner?• Ethiopia/Nigeria: How has been the experience of identifying household members that own durable/farm assets?

Page 29: Individual-Disaggregated  Questionnaire Design & Data in LSMS-ISA:  Too Many Shades of Grey?

Individual-Disaggregated Questionnaire Design & Data in LSMS-ISA: Too Many Shades of Grey?Talip KilicLiving Standards Measurement Study TeamPoverty & Inequality Group Development Research GroupThe World BankPresented at the 3rd annual Living Standards Measurement Study – Integrated Surveys on Agriculture (LSMS-ISA) project workshop at Zanzibar Beach Resort Hotel, Zanzibar, Tanzania, February 13-14, 2012