Mali 2014

Magpi Mobile Data Collection Lessons Learned: Mali Education Cluster

Context:In August 2014 the Mali Education Cluster conducted a sector needs assessment in Mali’s Kidal region. In preparation for the assessment the Cluster Coordinator in Bamako trained national NGO partners in assessment methodology, and use of the Magpi mobile data collection platform. NGO CarteONG, via NOMAD, provided remote technical support to the Mali Education Cluster in all phases of the evaluation (creation and testing of questionnaires on Magpi platform, development of Magpi training materials, data analysis).

Benefits/Successes Magpi platform

User friendliness: Compared to other platforms such as Open Data Kit (ODK), Magpi’s basic functions (questionnaire design, data entry, data analysis) require little prior technical knowledge from users. Basic utilization of the Magpi platform can be learned via brief on-line tutorials.

Improved data analysis: While using Magpi is more labor intensive in the design and preparation phases of the assessment (questionnaire design/staff training), data is collected in real-time (where internet/cellphone reception is available) requiring no manual data entry. This minimizes the risk of human error and allows for instant data analysis.

Capacity development: Using Magpi (especially with national actors) allowed to build local capacity to carry out future assessments utilizing mobile data collection technology.

Improved data security: In a context where assessment teams were operating in remote areas of high insecurity, real time data allowed to ensure collected data was stored securely in a timely manner.

NOMAD

Remote technical support: Working in a context where there is reduced Cluster capacity (i.e. no full time IM or co-lead), NOMAD provided timely and effective technical support, greatly reducing the workload of the Cluster Coordinator in all phases of the assessment.

Questionnaire testing: If you do not require support in creating questionnaires on the Magpi platform, having NOMAD review and test questionnaires can help reduce coding errors, and provide constructive feedback on questionnaire design.

Training support: NOMAD helped support the training of assessment teams by creating user manuals and training materials for the Magpi platform.

Assessment expertise: Having considerable experience carrying out assessments in various contexts, NOMAD provided critical guidance on logistical aspects of carrying out the assessment via mobile technology in remote/insecure contexts.

Challenges/Constraints

Mali 2014Magpi platform

Questionnaire design: While the backend of the Magpi platform is user-friendly, some limitations were noted when creating the online questionnaires, such as the inability to create cascading sheets (ex: automatic sorting of administrative zones). Depending on questionnaire design, coding restriction could be a limiting factor, and increase the likelihood of user error.

Limitations on small hand held devices: When using a hand held devices to collect data with less than a 5-inch screen, users reported fatigue and confusion in data entry. Note: Over concentration on handheld devices while interacting with key informants can hinder the “natural flow” of conversation, thus limiting information shared by key informants.

Cultural impact of mobile data collection: In the Kidal context, the collection of data via cellphone created a sense of alienation among target communities. To reduce concern, key informant interviews were first conducted via paper surveys, and later transferred to Magpi via mobile in a private setting. Note: Conversely, in some contexts the use of mobile technology to collect data can increase the perceived legitimacy of assessment teams.

NOMAD

Familiarity with Magpi: Though NOMAD was ultimately able to clarify all technical questions related to the Magpi platform.

Cost: While certainly a more cost effective option than having on the ground support, the cost of remote support must be factored into assessment budgets.