innovative approaches to m&e and project design
DESCRIPTION
This presentation uses two examples of projects covered by Internews to talk about the use of ICTs for M&E and innovative approaches to evaluate and collect data for Monitoring and Evaluation purposes.TRANSCRIPT
INNOVATIVE APPROACHES TO M&E AND PROJECT DESIGN
Anahi Ayala IacucciSenior Innovation AdvisorInternews
USING ICT FOR M&E IN DADAAB, KENYA
OVERVIEW OF THE HUMANITARIAN DATA TOOLKIT PILOT PROJECT - JANUARY 2013
1. How do we collect data in real time and assure the quality of our dataset?
2. How can we analyze data faster and without internet?
3. How do we harvest the knowledge of the local population when doing data collection?
THE PROBLEMS
THE NEEDS
We need a ready to deploy kit to do surveys
We need a methodology “out of the shelf” that we can replicate and teach in little time while guaranteeing the quality
We need to use a technology that can be customized and adapted to the local situation
THE PARTNERS
THE SOLUTION
1. An open source, free hardware and software package to be deployed in the field
2. A creative commons methodology to do surveys in the field using local communities
3. An offline/online system for data gathering and data aggregation using both mobile phones and papers
A laptop working also as server for FormHub. The computer has an extra battery that allows it to work for 24 hours without electricity
Power strips that can recharge also via USB.
A mini scanner that can also be powered via USB
Internet cables to connect the Wi-fi modem
Wi-fi modem
Android phones
Paper formsMulti USB Port
THE KIT
Form is created in XLS format and uploaded
into FormHub
Data is downloaded in XLS format
Data is collected on the ground
Form is downloaded into the phones
Data collected is uploaded
into FormHub
THE WORKFLOW
Paper forms are prepared and blank form is loaded into Captricity
Paper forms are used to collect data in the field
Paper forms are uploaded into Captricity for digitalization
Data is downloaded in XLS format
THE WORKFLOW
THE RESULTS
What isn’t visible in the graph is the qualitative improvement that we observed each day as well. There was a clear improvement in the enumerators’ facility and comfort with the phones, and also in their ability to correctly and efficiently do the paper-based surveys.
HARNESSING DESIGN FOR MEDIA DEVELOPMENTOVERVIEW OF HUMAN CENTERED DESIGN PILOT - SEPTEMBER 2012
AN ASIA TEAM/ICIL ‘EXPERIMENT/PILOT’
An IVR system to deliver election/ civics information to information ‘dark’ areas of FATA
IDEA
How do we know IVR is the most appropriate tech to use?
What if we try a different approach?
Thinking about user-centered design research how might ICIL approach this question?
QUESTIONS
What information do communities in FATA and KPK need to make better decisions that can improve their lives?
What are the most effective ways to get them critical information? What sources and channels are used and trusted?
How is technology changing how people access or share information? What will these behaviors look like in the next few years?
‣Uses ethnographic research approaches to better understand people
‣Help us learn about and interpret people’s needs, motivations, aspirations, and how they impact their behavior
‣Over time, process reveals the complex ecosystems in which people operate
DESIGN RESEARCH APPROACH
INTERVIEWS
OBSERVATION
SHADOWING
KEY TOOLS FOR THIS STUDY
USER DIARIES
Photo by Jan Chipchase under a Creative Commons License.
SERVICE TRIAL
SURVEYING
ARTIFACT COLLECTION
NOTE-TAKING
PHOTOGRAPHY
THEME 1: INFORMATION FLOWS
From what sources does a person get the information he or she needs? Once they get a piece of information, how do they choose who to share it with?
THEME 2: TRUST
How do people determine whether a piece of news or information is – or a source – is credible or trustworthy?
THEME 3: INFLUENCE
What is influence and reach of different information sources? How is influence determined and measured?
How does migration and displacement – both conflict-related and work-related – impact how FATA populations access and use information?
THEME 4: DISPLACEMENT
Impact: Design for Social Change | SVA | August 4, 2011
THEME 5: TECHNOLOGY & NEW MEDIA
How is new technology changing the ways people access, share, create, and evaluate information? What new media channels are people using, and for what purposes?
BENEFITS OF THIS APPROACH
‣NEW AND IMPROVED PROGRAMS/INITIATIVES THAT ARE:
‣ Improved, flexible, appropriate solutions
‣ Based on the actual needs of local communities
‣ Based on the actual capacities of local communities
‣ Informed by a deep understanding of the cultural and political context
‣ Sustainable, based on observed trends of information and technology behaviors into the future
‣ Higher probability of success/impact
BENEFITS OF THIS APPROACH
‣SUPPORTS, VALIDATES AND ENHANCES OUR UNDERSTANDING
‣ What we know and what we think we know
‣ Surface the unknown
‣ADDS TO AND ENHANCES CURRENT RESEARCH ENDEAVORS
‣NEW TOOLS AND APPROACHES FOR M&E:
‣ more insights into impacts and how to measure
‣ More potent and relevant measures of impact useful to us and to funders
‣ Blends beautifully with participatory approaches
Put people at the heart of problem-solving
Takes a systems approach to solutions
Identifies opportunities for impact
DESIGN RESEARCH
MOVING FORWARD
BENEFITS OF OUR APPROACH TO INNOVATION
‣THE IMPORTANT OF EXPERIMENTATION‣ A safe space for people to try, experiment and risk‣ The ability to act outside projects funding
mechanisms
‣ICT is not a silver bullet but it is a tool which use cannot be avoided
‣NEW TOOLS AND APPROACHES FOR M&E:‣ more DATA and better QUALITY‣ Tap into the local knowledge and make the local
communities the center of the system‣ Move the focus -M&E/research that looks to the
future rather than reporting past
THANK YOUTHANK YOU
STAY TUNED!