United States Agency for International Development Learning, Evaluation, and Analysis Project

Liberia Feed the Future Population-Based Survey

Presented lo USAID BurcRu for Food Security Thursday, .June 6, 2013

Presented by:

•OPTIMAL '\n1 ll I ION' ( tl~Ol 11'. I I<.

Murk Turner, President, LEAP Chief of Party Christabel Dndzie, LEAP Project Director

Af'\ln Moheshwnri, Software Development Manager

Agenda

Liberia Population-Based Survey Presentation to BFS

• Project Overview and Implementation

• Innovations and Effective Practices

• Capacity Development

• Lessons Learned

• Knowledge Sharing and Information Dise'?".1ination

• Survey Findings

• Questions and Answers

1

Liberia Population Based Survey Prese11tatio11 to BFS

Project Overview and Implementation

Project Assignment

Liberia Population-Based Survey Prese111atio11 to BFS

• Optimal Solutions Group, LLC was tasked to plan, design, and implement a population-based survey (PBS) for the United States Agency for International Development' s (USAID) Feed the Future initiative (FtF) in Liberia between July 2012 and March 2013

• Project Objectives:

)' Conduct a FtF baseline PBS in a defined Zone of Influence, and produce associated reports

)' Build capacity of the University of Liberia Pacific Institute of Research and Evaluation (UL-PIRE)

2

Liberia Population-Based Survey Prese11tatio11 to BFS

Overall PBS Implementation Plan • Needs assessment and planning • Initiation of capacity development activities • Dcvclo mcnt of recruitment and train in timeline

• On-the-job training • Field testing • Assessments

• Survey implementation • Field operations and monitoring • Data upload and quality assurance

)

Liberia Population Based Survey Final Pre!;e11tatio11

Innovations and Effective Practices

3

Liberia Population Based Survey Fbwl Prese11tatio11

Quality Assurance-Near Real Time Analysis

• QA activities leveraged the use of technology to promote tracking efficiently and reliability of the smvey results

})- OPS tracking on electronic tablets located surveys and confirmed implementation date and time

})- Dashboard for daily checks on progress and gaps

})- ln depth analysis of survey results every 3 days

• Benefits included:

})- Reduced the occurrence of fraudulent survey responses

})- Provided rapid feedback during implementation to fix errors in near-real time, and share good practices

Use of Dashboard

Liberia Population Based Survey Final Prese11tatio11

• A Dashboard was developed to chart process and check data outputs daily (data was uploaded from ODK to Spotfire)

})- Allowed for efficient sorting of entire data set and tracking on a daily basis

})- Consolidated and arranged dat'a on a single screen for monitoring at a glance

})- Reduced time spent on quality assurance review

})- Allowed for daily feedback to the field to fix errors with identifiers on survey and complete incomplete surveys

4

Liberia Population Based Survey Prese11tatio11 to BPS

QA of Complete and Incomplete Surveys

I WCOMPLffl MOout.Et I

- I_ "' ""

... ... -"" -J ""

• :"Oil'.:

t .... ... ""

1- , ..

"' ... j .

COYo"d!Tl

~

11'-'l\lllY OJITAll.I

- -rf»AU'• tl_,.,

t'.f!.-:"11¥. CO\W\lll

°"'~' " WtOCl(Cbl>f

\o(o.'l'f

. "'"'"" ..... ........... ·~=::~ • cOW\t •t•U CO~rt1 1M CO~l:lltll co~r.n

. ,IWl\1ill1JI

It:~::= ,.~., .. " e:o,,..,•rll•fl

• t<O...._tlitN ,~1110

·~··" ,~, .. ,, • tle.OUUl l .. "'

~:~:::r • • •llCOUl\lll• ... == ::: ..

t!!nnee1, t"°'NI I F '" ' ' ''

....... ......, ..

Liberia Population Based Survey Prese11tatio11 to BFS

QA on trends of Survey Responses I00t1 lht1 houuhold h•"• 1l1ttrlclty? 0Ut1!11n C6unt1 .. uon-e..11 Vl11J1.ll •.

....

'"

5

Liberia Population-Based Survey Pre5·e11tatio11 to BFS

Continuous In Depth QA Analysis

• After completion of surveying in each EA, an in depth analysis on the survey results was conducted and feedback provided to teams

• Survey teams returned to households to complete surveys that were faulty prior to leaving each EA and teams were restructured as needed.

QA Analysis

Appropriateness of EA selection

Check on response rate

Enumerator time spenl on surveys

EA Data Analysis

Commodity analysis (Water, Rice and Charcoal)

Review of survey responses and gaps

I

Liberia Population-Based Survey Prese11tatio11 to BFS

EA Household Selection QA Supervisor 10 EA: 3104 Grade: Poor

.......

. . . . . '

Supervisor 6 EA: 910 Grade: Perfect

6

Commodity Analysis

Liberia Population-Based Survey Prese11tatio11 to BFS

Water is consumed by all respondents, and so provides a rough test regarding the consistency of the recorded responses. Plotted the amount of water consumed by a household in the past week versus the cost of that water

~ 0

~ !l s ~ II o '!I 'I.' 0 0 \! e o 00 0 0 il Ii! OJ ood' o . G> D

~ ,01 D . D ""--

o~ oo o • • 8 0

'fl'" ....... o• 0 0

• • D .,, .. m8ooo Qi dlo D 0 0

0 liO 100 l!IO 200 250 300

A1Mumolil./l11r(om!lon1)

The regression line Is upward sloping a11d correlation betwee111he h1dfcators slg11iflca111fy positive, with a corre/at/011 co·efflcle11/ of 0.26.

Liber ia Population-Based Survey Prese11tatio11 to BFS

Other Effective Practices

• Used electronic equipment for sw·vey implementation to reduce complex data entry given the survey size

• Developed condensed survey form for electronic tablets

• Embedded quality assurance checks

• Provided mitigations for challenges (paper back up; extra tablets)

• Provided templates for documentation for promoting communication and capturing challenges during implementation

• Daily check-ins with survey implementation staff

7

J

Liberia Population Based Survey Presentation to BFS

Capacity Development

Liberia Population-Based Survey Prese11tatio11 to BFS

Building Capacity of a Local Entity: UL-PIRE

• Conducted a needs assessment of UL-PIRE's organizational and staffing capabilities

• Developed a capacity development plan for implementation at each phase

• Matched UL-PIRE team with LEAP staff for mentoring on project assignments (as possible)

• Provided re-training based on evaluations and assessments on various aspects of survey implementation (analytical; technology use; operations; management)

8

Liberia Population-Based Survey Presentation to BFS

Building Capacity of a Local Entity: UL-PIRE

• Created Standard Operating Procedures (SOPs)

• Modified survey instrument to fit the Liberian context

• Recruited, hired, and trained survey implementation staff

• Created operations manuals for survey implementation

• Reviewed all the major components of survey implementation

);;> Design and operations

)ii> Project and financial management

)ii> Data analysis and reporting

Liberia Population-Based Survey Prese11tatio11 to BFS

Lessons Learned

9

Liberia Population-Based Survey Prese11tt1tio11 to BFS

Major Lessons Learned included ...

• Survey instrument (length; recall bias)

• Subcontracting versus consulting with local entity

• Processes for equipment shipment and clearance

• Establishing project protocols for accounting and expense report compliance with local entity

• Managing large teams with varying skill sets

• Effective communication and coordination within and across teams

·USAID Libel'ia Population-Based Survey Prese11talio11 lo BFS

Knowledge Sharing and Information Dissemination

10

Liberia P opulation Based Survey Final Presentatio11

Options for Knowledge Sharing and Information Dissemination

• Final Survey and Capacity Development Rep01ts

)1> Executive Summary

• Project Manuals

)1> Supervisor; Enumerator; Equipment training; Data upload; Operations templates; Quality Assurance; Data Analysis

The following are being developed:

• Project Pamphlet

• Dashboard for data access and dissemination

Libe•·ia Population Based Survey Final Presentation

Survey Findings

11

Sampling Design

> Cluster Sampling

Liberia Population Based Survey Filla/ Presentation

}> Selected from Enumeration Areas (EA's)

)> EAs based on Liberian Census 2008

}> 120 Enumerator Areas

.li> Approximately 20 households per EA

}> Total sample size of 2,400 households

)I> Sampling Design and Framework were based on FtF guidelines and approved by BFS

Survey Results

)I> Five main categories:

)> Demographics

)> Consumption

)> Poverty

)> Hunger

.)i> Women's Empowerment

Liberia Population Based Survey Filla/ Preseutatio11

12

Liberia Population Based Survey Final Prese11tatio11

Demographics Sun·ey data for demoKraphics results

I lo11~..t1olclt1 8111'\"t'.I'" U1·.<p111111t' I lo11,:1•hol1I Sn111pll'cl ('11111plc•lc•t l l'latt• S i:w

llon~ :.150 ;j;j() O.!J!J .i.s C:rn11tl Oni<s11 198 l!l .j

1.c1fo :.!G!l 201 0.117 I. ~lnl'µ.ilii 171< 17(i (J.!HJ .1.f)

~ lomn\'ia '2 807 0.!11 ·I ~ Jo11f 1<Ct'l'llclo I :w 1:1 I O.!JD r .. :1 Ni111h11 1'i•ll .·1 IO 1 r1.2 Unk11ow11 9 1 7 0.07 Ni\ 011l ;.i1k i\ lo11rcl\'ii1 1,li8 1 l ,@5 (J.!HJ (j

To tnl 2,li.'ii 2. 17!1 O.!J:I l.fi

Liberia Population Based Survey Final Prese11tatio11

WEAi

• Measures how much input women have in productive activities and decision-making

• WEA! is a combination of two indices:

• Five Domains of Empowerment (SOE)

• Gender Parity Index (GPI)

Women's Empowerment Scores Baseline value

5DE Index

GPI

WEAi

.66

.95

.69 _u

13

WEAi

Liberia Population Based Survey Final Prese11tatio11

Empowerment by gender in the survey area

E111 pO\\'<'rN l E1u powen.ic I Fcmnk:.: l\ (1\lc~

13onJ!; 0.15 0.2 G rn ncl Dnssa 0.21 0.42

Lo fa 0.18 0 .33 J\Jnrgibi 0.18 o.rn

l.lonrovia ().(Jtl 0.1)8

l\·I o n t.RCl'nl,(!O 0.28 o.:37 Niml>a 0.35 0.55

Outside ~Ionrovia 0.23 o .:JG Total 0.17 0.28

NOTE: Timi~ H'8t1lt11 arn rn>t. wt>i)lhtt'<I m·1·<m li n)!. to thtt snm· p lillV: cfri<i~ll lltlCl t )1111< ou J.\· npply l ll Uw .SllrV<l)' pOpUIH 1 iou .

Liberia Population-Based Survey Prese11tatio11 to BFS

Questions and Answers

14

Liberia Population-Based Survey Presentation to BFS

Thank you! LEAP Contact:

leap@optimalsolutionsgroup,com

Mark Turner, Chief of Party mturner@optimalsolutionsgroup.c(J'l1

Christabel Dadzie, Project Director cdadzic@optimalso lutionsgroup, com

OPTIMAL ~<Hl ll'lr \(,~ 11 l',J I<

15