food for peace data quality assessment · food for peace data quality assessments. 22 reporting...
TRANSCRIPT
![Page 1: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/1.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTS
FOOD FOR PEACE DATA QUALITY ASSESSMENT
Pamela Velez‐Vega, Monitoring & Evaluation Advisor, FANTA ProjectDan Houston, Monitoring and Evaluation Specialist, USAID/Southern Africa/FFP
March 2nd, 2016
Food and Nutrition Technical Assistance III Project (FANTA)FHI 360 1825 Connecticut Ave., NW Washington, DC 20009Tel: 202‐884‐8000 Fax: 202‐884‐8432 Email: [email protected] Website: www.fantaproject.org
![Page 2: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/2.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 2
Session Objectives
Participants will:
1. Identify four key data quality assessment (DQA) requirements from the FFP Monitoring and Evaluation Policy document
2. Assess an indicator using five data quality standards
3. Review an illustrative DQA process and potential pitfalls to avoid
![Page 3: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/3.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 3
FFP Data Quality Assessment (DQA) Definition
A systematic and periodic review of the data quality of indicators that FFP development projects report annually.
![Page 4: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/4.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 4
Purpose
To improve data quality with the ultimate goal of improving accountability and decision making.
Bad Data
Good Data
![Page 5: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/5.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 5
Purpose
A DQA is designed to:
1. Verify the quality of data
2. Assess the system that produces that data
3. Develop action plans to improve both
![Page 6: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/6.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 6
DQA Requirements for FFP Development Projects
![Page 7: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/7.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 7
Requirement Number 1
DQA on annual monitoring indicator data
Preferably on project‐specific indicators from non‐survey data collection methods
Your Data
![Page 8: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/8.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 8
Requirement Number 1 (cont.)Universe of annual monitoring indicator data
FFP annual monitoring indicators
Project‐specific annual monitoring indicator data collected through beneficiary‐based surveys
Project‐specific annual monitoring indicators collected through routine monitoring
Focus of DQA
![Page 9: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/9.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 9
Requirement Number 2
Provide description of plans for DQA on an annual basis
Life of Award
M&E Plan PREP PREP PREP PREP
Year 1 Year 2 Year 3 Year 4 Year 5
![Page 10: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/10.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 10
What must the description of the plan for DQA include?
![Page 11: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/11.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 11
Requirement Number 3
Description of plan for DQA should include:
• Indicators to be assessed and justification for selection
• Timeframe: timing and duration• Methodology• DQA staff roles and qualifications
![Page 12: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/12.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 12
Requirement Number 4
Select a sample of indicators for DQA annually
Purposive sample based on:• Importance of indicator to ToC• Identified and perceived data quality risks
associated with indicator• Timing and availability of staff• Frequency and timing of data collection• Other factors
![Page 13: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/13.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 13
Selecting Indicators for DQACategorize indicators:
• Similar data flows• Output vs. Outcome
![Page 14: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/14.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 14
Data FlowsR
EP
OR
TIN
G L
EV
ELS
M&E Unit
Intermediate aggregation levels
(e.g., districts, regions)
Service delivery points
Source: Adapted from Measure Evaluation
Photo: Jessica Scranton, FANTA/FHI 360
![Page 15: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/15.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 15
A DQA is designed to:
1. Verify the quality of data
2. Assess the system that produces that data
3. Develop action plans to improve both
![Page 16: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/16.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 16
Data Quality
![Page 17: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/17.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTS
Data Quality Standards
17
Validity Reliability
Precision Integrity
Timeliness
![Page 18: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/18.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 18
A DQA is designed to:
1. Verify the quality of data
2. Assess the system that produces that data
3. Develop action plans to improve both
![Page 19: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/19.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 19
Data‐Management and Reporting System
![Page 20: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/20.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 20
REPO
RTING LEV
ELS
Quality Data
Source: Adapted from Measure Evaluation
M&E Unit
Intermediate aggregation levels
(e.g., districts, regions)
Service delivery points
Data‐m
anagem
ent a
nd re
porting system
![Page 21: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/21.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 21
Functional Components of Data‐Management System Needed to Ensure Data Quality
I. M&E structures, functions, and capabilities
II. Indicator definitions and reporting guidelines
III. Data collection tools and reporting forms
IV. Processes of data verification, aggregation, processing, management, storage, and safeguarding
V. Data use and dissemination
VI. Links with national reporting systems (where relevant)
Source: Adapted from Measure Evaluation
![Page 22: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/22.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 22
RE
PO
RTI
NG
LE
VE
LS
Quality Data
M&E Unit
Intermediaggregation(e.g., distr
regions
ate levels icts, )
Service delivery points
Data‐m
anagem
ent a
nd re
porting system
Quality Standards
Validity, Reliability, Precision,Integrity, Timeliness
Functional Components of Data‐Management System Needed to Ensure Data
QualityI. M&E structures, functions, and
capabilitiesII. Indicator definitions and reporting
guidelinesIII. Data collection tools and reporting
forms IV. Processes of data verification,
aggregation, processing, management, storage, and safeguarding
V. Data use and dissemination
VI. Links with national reporting systems (where relevant)
Source: Adapted from Measure Evaluation
![Page 23: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/23.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTS
DQA Requirements for FFP Development ProjectsData Quality Standards
23
Validity Reliability
Precision Integrity
Timeliness
![Page 24: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/24.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS
Case ExampleYou are the DQA team leader for a FFP development food assistance project. You are verifying the quality of the data for the following indicator:
Number of kilograms (kg) produced as a result of participation in project’s technology transfer
• Tilapia• Maize
24
Photos: Jessica Scranton, FANTA
![Page 25: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/25.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS
Number of kg of tilapia/maize produced as a result of participation in project’s technology transfer
25
Are we measuring Validity what we believe we
are measuring?
![Page 26: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/26.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 26
Validity
Key Functional Components of a Data‐Management System that Impact Validity
I. M&E structures, functions, and capabilities
II. Indicator definitions and reporting guidelines
III. Data collection tools and reporting forms
IV. Processes of data verification, aggregation, processing, management, storage, and safeguarding
V. Data use and dissemination
VI. Links with national reporting systems (where relevant)
![Page 27: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/27.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTS
Number of kg of tilapia/maize produced as a result of participation in project’s technology transfer
ReliabilityDo data reflect stable and consistent definitions and data collection processes and analysis methods over time?
FOOD FOR PEACE DATA QUALITY ASSESSMENTS 27
![Page 28: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/28.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 28
Reliability
Key Functional Components of a Data‐Management System that Impact Reliability
I. M&E structures, functions, and capabilities
II. Indicator definitions and reporting guidelines
III. Data collection tools and reporting forms
IV. Processes of data verification, aggregation, processing, management, storage, and safeguarding
V. Data use and dissemination
VI. Links with national reporting systems (where relevant)
![Page 29: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/29.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTS
Number of kg of tilapia/maize produced as a result of participation in project’s technology transfer
Precision
Do data have a sufficient level of detail to permit management decision making and/or comply with reporting requirements? E.g. level of disaggregation, avoid over or underreporting.
FOOD FOR PEACE DATA QUALITY ASSESSMENTS 29
![Page 30: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/30.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 30
Precision
Select Key Functional Components of a Data‐Management System that Impact Precision
I. M&E structures, functions, and capabilities
II. Indicator definitions and reporting guidelines
III. Data collection tools and reporting forms
IV. Processes of data verification, aggregation, processing, management, storage, and safeguarding
V. Data use and dissemination
VI. Links with national reporting systems (where relevant)
![Page 31: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/31.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 31
Number of kg of tilapia/maize produced as a result of participation in project’s technology transfer
IntegrityDo the data collected, analyzed, and reported have established mechanisms in place to reduce manipulation or simple errors in transcription?
![Page 32: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/32.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 32
Integrity
Select Key functional Components of a Data‐Management System that Impact Integrity
I. M&E structures, functions and capabilities
II. Indicator definitions and reporting guidelines
III. Data collection tools and reporting forms
IV. Processes of data verification, aggregation, processing, management, storage, and safeguarding
V. Data use and dissemination
VI. Links with national reporting systems (where relevant)
![Page 33: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/33.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 33
Number of kg of tilapia/maize produced as a result of participation in project’s technology transfer
TimelinessAre data available at a useful frequency? Are data current and timely enough to influence management decision making?
![Page 34: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/34.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 34
Select Key Functional Components of a Data‐Management System that Impact Timeliness
I. M&E structures, functions, and capabilities
II. Indicator definitions and reporting guidelines
III. Data collection tools and reporting forms
IV. Processes of data verification, aggregation, processing, management, storage, and safeguarding
V. Data use and dissemination
VI. Links with national reporting systems (where relevant)
Timeliness
![Page 35: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/35.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS
Illustrative DQA Process
• Step 1. Develop an overall approach and schedule
• Step 2. Identify the indicators and sites to be included
in the review
• Step 3. Identify the DQA team
• Step 4. Develop a budget and logistics plan
• Step 5. Develop and pilot DQA tools or instruments
• Step 6. Train DQA reviewers
35
![Page 36: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/36.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTS
• Step 7. Conduct the DQA
• Step 8. Prepare DQA draft report
• Step 9. Report review
• Step 10. Follow up on Actions
• Step 11. Submit DQA report to FFP through FFPMIS
as part of the Annual Results Report
FOOD FOR PEACE DATA QUALITY ASSESSMENTS 36
Illustrative DQA Process
![Page 37: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/37.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS 37
Sample DQA Checklist
![Page 38: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/38.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS
Potential Pitfalls to Avoid
1. Data security issues
2. Lack of assigned budget and personnel for annual DQA
3. Lack of data traceability standards
4. Filing system inconsistencies
5. Incomplete requirements in collection forms
6. Insufficient training and knowledge refreshers
38
![Page 39: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/39.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS
Potential Pitfalls to Avoid
7. Lack of standardized processes/tools/indicators definitions
8. Inconsistent data‐collection methodology among prime and sub‐awardees (for projects run by consortium)
9. Insufficient standards to verify and cross‐check data
10.Insufficient follow up on actions
39
![Page 40: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/40.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTSFOOD FOR PEACE DATA QUALITY ASSESSMENTS
Resources• USAID. Draft. USAID’s Office of Food for Peace Policy and Guidance for
Monitoring, Evaluation, and Reporting for Development Food Assistance Projects, Section 3.2: Data Quality Assurance, Management, and Safeguard.
• USAID. 2012. ADS Chapter 203: Assessing and Learning. Available at: http://www.usaid.gov/sites/default/files/documents/1870/203.pdf
• Measure Evaluation. Data Quality Assurance Tools. Available at: http://www.cpc.unc.edu/measure/resources/tools/monitoring‐evaluation‐systems/data‐quality‐assurance‐tools
• USAID. 2010. Performance Monitoring & Evaluation TIPS: Conducting Data Quality Assessments. Available at: http://pdf.usaid.gov/pdf_docs/Pnadw118.pdf
• USAID. 2009. Performance Monitoring & Evaluation TIPS: Data Quality Standards. Available at: http://pdf.usaid.gov/pdf_docs/Pnadw112.pdf
40
![Page 41: Food for Peace Data Quality Assessment · FOOD FOR PEACE DATA QUALITY ASSESSMENTS. 22 REPORTING LEVELS. Quality Data M&E Unit Intermedi aggregation (e.g., distr regions ate levels](https://reader033.vdocuments.us/reader033/viewer/2022060523/6053111990338345683f3610/html5/thumbnails/41.jpg)
FOOD FOR PEACE DATA QUALITY ASSESSMENTS
This presentation is made possible by the generous support of the American people through the support of the Office of Health, Infectious Diseases and Nutrition, Bureau for Global Health, U.S. Agency for International Development (USAID) and the Office of Food for Peace, Bureau for Democracy, Conflict and Humanitarian Assistance, under terms of Cooperative Agreement No. AID‐OAA‐A‐12‐00005, through the Food and Nutrition Technical Assistance III Project (FANTA), managed by FHI 360. The contents are the responsibility of FHI 360 and do not necessarily reflect the views of USAID or the United States Government.
41