innovative approaches to m&e and project design

INNOVATIVE APPROACHES TO M&E AND PROJECT DESIGN

Anahi Ayala IacucciSenior Innovation AdvisorInternews

USING ICT FOR M&E IN DADAAB, KENYA

OVERVIEW OF THE HUMANITARIAN DATA TOOLKIT PILOT PROJECT - JANUARY 2013

1. How do we collect data in real time and assure the quality of our dataset?

2. How can we analyze data faster and without internet?

3. How do we harvest the knowledge of the local population when doing data collection?

THE PROBLEMS

THE NEEDS

We need a ready to deploy kit to do surveys

We need a methodology “out of the shelf” that we can replicate and teach in little time while guaranteeing the quality

We need to use a technology that can be customized and adapted to the local situation

THE PARTNERS

THE SOLUTION

1. An open source, free hardware and software package to be deployed in the field

2. A creative commons methodology to do surveys in the field using local communities

3. An offline/online system for data gathering and data aggregation using both mobile phones and papers

A laptop working also as server for FormHub. The computer has an extra battery that allows it to work for 24 hours without electricity

Power strips that can recharge also via USB.

A mini scanner that can also be powered via USB

Internet cables to connect the Wi-fi modem

Wi-fi modem

Android phones

Paper formsMulti USB Port

THE KIT

Form is created in XLS format and uploaded

into FormHub

Data is downloaded in XLS format

Data is collected on the ground

Form is downloaded into the phones

Data collected is uploaded

into FormHub

THE WORKFLOW

Paper forms are prepared and blank form is loaded into Captricity

Paper forms are used to collect data in the field

Paper forms are uploaded into Captricity for digitalization

Data is downloaded in XLS format

THE WORKFLOW

THE RESULTS

What isn’t visible in the graph is the qualitative improvement that we observed each day as well. There was a clear improvement in the enumerators’ facility and comfort with the phones, and also in their ability to correctly and efficiently do the paper-based surveys.

HARNESSING DESIGN FOR MEDIA DEVELOPMENTOVERVIEW OF HUMAN CENTERED DESIGN PILOT - SEPTEMBER 2012

AN ASIA TEAM/ICIL ‘EXPERIMENT/PILOT’

An IVR system to deliver election/ civics information to information ‘dark’ areas of FATA

IDEA

How do we know IVR is the most appropriate tech to use?

What if we try a different approach?

Thinking about user-centered design research how might ICIL approach this question?

QUESTIONS

What information do communities in FATA and KPK need to make better decisions that can improve their lives?

What are the most effective ways to get them critical information? What sources and channels are used and trusted?

How is technology changing how people access or share information? What will these behaviors look like in the next few years?

‣Uses ethnographic research approaches to better understand people

‣Help us learn about and interpret people’s needs, motivations, aspirations, and how they impact their behavior

‣Over time, process reveals the complex ecosystems in which people operate

DESIGN RESEARCH APPROACH

INTERVIEWS

OBSERVATION

SHADOWING

KEY TOOLS FOR THIS STUDY

USER DIARIES

Photo by Jan Chipchase under a Creative Commons License.

SERVICE TRIAL

SURVEYING

ARTIFACT COLLECTION

NOTE-TAKING

PHOTOGRAPHY

THEME 1: INFORMATION FLOWS

From what sources does a person get the information he or she needs? Once they get a piece of information, how do they choose who to share it with?

THEME 2: TRUST

How do people determine whether a piece of news or information is – or a source – is credible or trustworthy?

THEME 3: INFLUENCE

What is influence and reach of different information sources? How is influence determined and measured?

How does migration and displacement – both conflict-related and work-related – impact how FATA populations access and use information?

THEME 4: DISPLACEMENT

Impact: Design for Social Change | SVA | August 4, 2011

THEME 5: TECHNOLOGY & NEW MEDIA

How is new technology changing the ways people access, share, create, and evaluate information? What new media channels are people using, and for what purposes?

BENEFITS OF THIS APPROACH

‣NEW AND IMPROVED PROGRAMS/INITIATIVES THAT ARE:

‣ Improved, flexible, appropriate solutions

‣ Based on the actual needs of local communities

‣ Based on the actual capacities of local communities

‣ Informed by a deep understanding of the cultural and political context

‣ Sustainable, based on observed trends of information and technology behaviors into the future

‣ Higher probability of success/impact

BENEFITS OF THIS APPROACH

‣SUPPORTS, VALIDATES AND ENHANCES OUR UNDERSTANDING

‣ What we know and what we think we know

‣ Surface the unknown

‣ADDS TO AND ENHANCES CURRENT RESEARCH ENDEAVORS

‣NEW TOOLS AND APPROACHES FOR M&E:

‣ more insights into impacts and how to measure

‣ More potent and relevant measures of impact useful to us and to funders

‣ Blends beautifully with participatory approaches

Put people at the heart of problem-solving

Takes a systems approach to solutions

Identifies opportunities for impact

DESIGN RESEARCH

MOVING FORWARD

BENEFITS OF OUR APPROACH TO INNOVATION

‣THE IMPORTANT OF EXPERIMENTATION‣ A safe space for people to try, experiment and risk‣ The ability to act outside projects funding

mechanisms

‣ICT is not a silver bullet but it is a tool which use cannot be avoided

‣NEW TOOLS AND APPROACHES FOR M&E:‣ more DATA and better QUALITY‣ Tap into the local knowledge and make the local

communities the center of the system‣ Move the focus -M&E/research that looks to the

future rather than reporting past

THANK YOUTHANK YOU

STAY TUNED!