Multiple Indicator Cluster SurveysSurvey Design Workshop

Data Analysis and Reporting

MICS Survey Design Workshop

• Provide an overview of the MICS process in analyzing data

• Provide an overview of the preparation of the Summary Findings and the Final Report

Purpose

• Data entry and processing programs will be covered in second workshop

• Standard set of MICS tabulations and guidelines will be provided

• Standard guidelines and templates for Summary Findings and Final Report will be provided

Process for report preparation

Process for report preparation

• Technical support for data analysis and report writing will be through UNICEF regional consultants

• Once a draft final report is produced, a review process is initiated with the Regional and Global MICS Team

• Carry out basic checks of data quality (non-sampling errors) using the Data Quality Tables

• Calculate response rates

• Response rates lower than 90% suggest results may be biased

Before producing tabulationsand writing reports

• Check for variables with large numbers of Missing.

• Make sure it is not a problem with data entry or editing

• Any variable with 10% or more missing values, use with caution; if very high, do not use at all

Before producing tabulationsand writing reports (continued)

• Check for variables with large numbers of “Don’t know” or “Other” answers.

• Large numbers of DKs can indicate difficulty understanding the questions

• High proportions of “Other” indicates questionnaire did not account for most common responses

Before producing tabulationsand writing reports (continued)

• Check for expected patterns in the data.

• Unexpected patterns may result from • faulty sample design, • improper implementation of the sample,• interviewer errors, or• respondents’ inaccurate answers.

Before producing tabulationsand writing reports (continued)

• Decide on basic background variables and their groupings- Geographic areas, urban/rural residence, level of education, male/female, wealth quintiles, religion of household head, etc.

• Calculate the wealth index

Before producing tabulationsand writing reports (continued)

• Use tabulation plan• Check unweighted number of observations

for displaying results• Cells based on very small numbers of cases are not

reliable and should not be shown; results based on fewer than 25 unweighted cases should not be shown, 25-49 unweighted cases should be shown within parentheses (caution)

Producing final tables

The MICS Report Templates

There are two templates available in MICS which can be customized by countries depending on the content of the survey:

1. Summary Findings Report2. Final Report

Templates are/will be available in English, French, Arabic, Russian and Spanish.

MICS Report Templates

Why use the MICS templates? • To facilitate the efficient production of MICS reports

so countries do not have to “reinvent the wheel” and spend time on the design of tables, indicator explanations etc.

• To ensure the production of comparable reports that can be used easily to draw comparisons between countries.

• To increase confidence among users in the survey; MICS is a recognised household survey programme with an internationally accepted methodology

The Summary Findings Report

• A very short and visual report that does not need a lot of text/writing.

• The tables and topics included in the report are a subset of the final report

• Quick results on critical indicators such as mortality and malnutrition to allow for possible programme response as soon as possible.

• Will buy time while working on the final report• See childinfo.org for examples

• Make sure that data quality is taken into account during report writing

• When comparing findings to previous results or between groups, make sure that sampling errors are taking into account

Describing findings

Content of the Final Report Template

Front Matter Foreword, Executive Summary, Contents, Summary Table of Findings

Introduction

Sample and Survey Methodology

Results Chapters (presented by theme)

Appendices

Sample Design

Personnel Involved

Estimates of Sampling Errors

Data Quality Tables

Indicator List

Questionnaires

The Final Report

• To convey the results of the survey to a wide audience which includes government agencies, non-governmental organizations, other multilateral donors, the press, and the general public

• The report describes the current situation of children and women taken from all indicator results included in the survey. It also includes detailed information on survey methodology and implementation.

• See childinfo.org for examples

Who should write the Final Report?

• Once tables are generated and finalized it should be quite straight forward to write the report.

• Typically it is the MICS implementing agency and/or members of a stakeholder/technical committee who write the report. Chapters can be divided among different people. It is useful to have people familiar with subject matter.

• Experts in various fields should be consulted and asked to review the tables in order that the key messages and any unusual findings are addressed and dealt with properly in the report and that technical terminology is appropriately used.

Report Writing

• Will partly be covered during the 3rd MICS Workshop: Data Dissemination and Further Analysis

• However, the writing process should begin earlier. The survey teams should not wait for attending the workshop to start preparing the reports

• See childinfo.org for MICS4 3rd workshop presentation files

Dissemination of Findings

• There will be a separate workshop session

• 3rd MICS Workshop: Data Dissemination and Further Analysis

• National seminar, distribution of findings, other dissemination activities

MICS data can be used for statistical analysis beyond that contained in the survey report

• The data collected should be exploited as fully as possible

• 3rd MICS Workshop: Data Dissemination and Further Analysis

• Potential topics for further analysis: – Analysis of data quality, Analysis of trends– Identification of “most vulnerable” groups– Multivariate analyses of determinants of child health or schooling outcomes

Further Analysis of the Data