list of acronyms - wfp remote access secure...
TRANSCRIPT
Decentralized evaluation for evidence-based decision makingWFP Office of Evaluation
Decentralized Evaluation Quality Assurance System (DEQAS)
Evaluation Inception Report TEMPLATE
Version November 2015
Who is this Template for? This Template is for the development of an Inception Report for a WFP decentralized evaluation. It should be applied by staff who are commissioning or managing a decentralized evaluation and by evaluation teams who are preparing the Inception Report.
What is the purpose of this Template? This template provides a suggested structure and guidance on content for writing the Inception Report for a decentralized evaluation. In doing so it sets out WFP’s expectations for its Inception Reports of decentralized evaluations.
How should this Template be used? This template is used alongside the Quality Checklist for Inception Reports to help ensure that all the elements of the quality standards are adequately addressed.
How is this Template structured? Within this Template:
A box containing guidance is provided at the start of each section, where necessary.
Text presented in italics provides guidance for the template user Text in standard format is suggested content for the Inception Report Text in [highlighted square brackets] indicates that this part should be
completed by the user Reference to various elements of the guidance is underlined
Other key materials? Additional relevant guidance can be found in:
The Process Guide for Decentralized Evaluations, which sets out the Phases of an evaluation and how to implement each one;
Relevant Technical Notes, particularly those which relate directly to the type of evaluation for which the Inception Report is being prepared
Decentralized Evaluation
Decentralized evaluation for evidence-based
decision making
Prepared by[name, Team Leader][name, title of team member 1][name, title of team member etc]
[Month Year][Name of commissioning office]Evaluation Manager [Name of Evaluation Manager]
[Evaluation Title][Period covered] Inception Report
Table of Contents
List of Acronyms..............................................................................................1. Introduction..............................................................................................2. Context......................................................................................................3. [Subject of the Evaluation]........................................................................4. Stakeholder analysis.................................................................................5. Evaluation approach and methodology.....................................................5.1................................................................................Proposed approach and methodology
65.2....................................................................................................................................Site mapping
65.3....................................................................................Data Collection Methods and Tools
65.4..................................................................................................................Limitations and risks
75.5.............................................................................................................................Ensuring quality
76. Organization of the evaluation..................................................................6.1.........................................................................................Team composition and workplan
76.2..............................................................................................................................................Timeline
86.3...........................................................................................................Data collection schedule
96.4...............................................................................................Support/Information required
9Annexes.........................................................................................................Annex 1 Map..............................................................................................Annex 2 Evaluation Matrix......................................................................Annex 3 Data Collection Tools...................................................................Annex 4 Evaluation Mission Schedule.......................................................Annex 5 Documents gathered....................................................................
List of Acronyms
OEV Office of EvaluationSOP Standard Operating ProcedureTOR Terms of ReferenceWFP World Food Programme
Inception Report template Version November 2015 1 | P a g e
The Inception Report ensures that the evaluation team (leader and members) have an in-depth understanding of the TOR of the evaluation. It translates the TOR into an operational plan according to which the evaluation will be carried out. The Inception Report is a working document which forms the agreement between the Evaluation Manager and the Evaluation team on the operational plan for the evaluation.The maximum length for an Inception Report (excluding Annexes) is 20 pages.
1. Introduction
Provide a brief introduction including key characteristics of the decentralized evaluation:
Main purpose for the evaluation Expected users for the evaluation WFP’S strategic context for the evaluation
Length: 1-2 pages
1. This Inception Report is for the evaluation of [evaluation subject] in [geographic area]. This evaluation is commissioned by [name of Commissioning Office] and will cover the period from [month/year] to [month/year].
2. The main objectives of the evaluation are [list accountability and learning objectives as per the TOR].
3. The purpose of this Inception Report is to provide the main operational plan for the evaluation. It provides information on the context, the subject of the evaluation, its stakeholders, the approach and methodology that will be used for the evaluation, and how the evaluation will be organized. It also provides information on how the evaluation will be disseminated and used. The expected users for this Inception Report are [specify].
4. [Provide any additional information that is relevant to the evaluation].
2. Context
Provide a brief overview of the country context directly relevant to the evaluation. Provide sufficient information to understand the implications of context for the activity under evaluation. Include information about: Poverty, food security in relation to the subject of the evaluation Government policies and priorities in relation to food security/the subject
of the evaluation Humanitarian issues as they relate to food security and the subject of the
evaluation Gender dimensions of the context, in relation to food security, nutrition
Inception Report template Version November 2015 2 | P a g e
situation and the subject of the evaluation The gender situation in the country more broadly, including gender
architecture, government strategy and policies to address gender inequality, and relevant gender indicators e.g. Gender Inequality Index.
Key external events which led to significant changes in WFP’s work (such as migration patterns or host community/social tensions)
Features of international assistance in the area: Long-standing donors/agencies in the country, level of resources, humanitarian and development assistance etc.
Other WFP work in the area and related work of other humanitarian/development actors
Maximum length: 3-4 pages
[Evaluation team text to be added reflecting the above contextual information]
3. [Subject of the Evaluation]
Include key facts and description of the subject of the evaluation, namely: Type of intervention (operation, activity, thematic area, transfer
modality, pilot project) Geographic scope of the evaluation subject Relevant dates: Approval date; start date; end date Planned outputs at design
o Beneficiary numbers (planned and revised) disaggregated by gender/activity
o Amount of transfers (food, cash, vouchers)o Any other outputs, including those related to capacity development
and technical assistance Planned outcomes at design Key activities Main partners (Government; NGOs; Bilateral; Multilateral) Resources (% funded of total requirements) and key donors. If subject
funded from pooled funds or if the evaluation covers one component/activity of an operation, show resource allocated to the subject of evaluation
Other relevant preceding/ concurrent activities/ interventions/operations
Any amendments to initial design Gender equality and women’s empowerment dimensions relevant to
subject of the evaluation and context Quality of gender analyses undertaken and integrated in programme
design.
Length: maximum 2 pages
Inception Report template Version November 2015 3 | P a g e
Timing
Include: Approval date Duration of the intervention Budget revisions (if appropriate)
Objectives and Activities
Include: Strategic objectives if applicable Key activities (where e.g. an operation is being evaluated)
Outputs and planned beneficiaries
Include: Planned outputs of the intervention Tonnage/cash/vouchers distributed if applicable Planned beneficiaries of the intervention, disaggregated by sex, age
and other categories as appropriate
Outcomes
List the planned outcomes of the intervention, and achievements as determined from the data available at the inception phase
Logical Framework or Logic Model
Provide the Logical Framework or Logic Model (or similar tool e.g. a results framework) for the intervention if available. If not available, the evaluation team will have to reconstruct it in order to inform the evaluation matrix and get it approved by the evaluation commissioner during the inception phase. The implications of applying the reconstructed version will need to be explained. See TN on Logical Frameworks and Logic Models.
Partners
List key partners involved in the intervention e.g.: Government United Nations agencies NGOs Private sector
Resource requirements and funding situation
Include: Total resource requirements and budget allocated to date (Planned
budget at the start of the evaluation period and funding level at the end
Inception Report template Version November 2015 4 | P a g e
of the evaluation period; description of revisions)main donors
Any changes in the above features over time
Gender dimensions of the intervention
Explain the gender dimensions of the intervention: Which aspects of gender the intervention sought to address Through which strategies Any gender-related targets and intended results How gender dimensions were intended to be measured
4. Stakeholder analysis
Building on the preliminary stakeholder information from the TOR, provide stakeholder analysis, including
• Who the different groups involved in the evaluation subject are with reference to specific agencies or individuals;
• What their stake in the evaluation is and;• How they will be involved in the evaluation, with consideration of
the most appropriate method for each group.• Whenever relevant clarify expected use
See TN on Stakeholder Analysis
Length: 1-2 pages
[Insert relevant analysis and diagnostic tool applied]
Table 1: Sample Stakeholder analysis and mapping
Stakeholder
Interest in the [
Intervention/Project/Operation]
Involvement in Evaluation and
likely use
Who (specifically
for the Evaluation)
Internal (WFP) stakeholders
External stakeholders
5. Evaluation approach and methodology
Provide detailed information about the overall methodological approach that
Inception Report template Version November 2015 5 | P a g e
will be used to undertake the evaluation and the methods selected for data collection and analysis. Ensure a comprehensive and systematic description, which is sufficient to generate trust in the credibility of the evaluation as well as its independence and impartiality.
Include information about: Evaluation criteria and questions will be applied (See TN on Evaluation
Criteria and Questions). Building on the criteria and questions identified in the TOR refine/clarified the evaluation questions so that they can be meaningfully addressed in the evaluation report.
The conceptual and methodological approach that will be applied, and how it will minimize threats to validity and ensure reliability and credibility of the evaluation (See TN on Methods )
The Evaluation Matrix (provide in an Annex - see TN on Evaluation Matrix )
The specific tools that will be applied (see TN on Methods ) How the perspective of key stakeholders will be included How the evaluation methodology will be gender-responsive, including
any data collection method employed to seek information on gender issues and ensure the inclusion of women and marginalised groups (See TN on integrating gender in WFP evaluations, Checklist, and Quick Guide )
How independence and impartiality will be safeguarded in the evaluation’s design (see TN on Independence and Impartiality )
What limitations are likely to arise, and how these will be mitigated
Length: maximum 3-4 pages
5.1. Proposed approach and methodology
Describe evaluation criteria, questions and the overall methodological approach. Ensure that the selection of evaluation criteria is justified, and their application in the evaluation clear. Link evaluation questions explicitly to each of the chosen criteria.Detail the Evaluation Matrix, its role in the evaluation and how it has been developed, and how it will be applied. Specify the use of a mixed-methods approach. Describe availability and reliability of data/information and the data requirements to ensure rigour in the evaluation process. To accomplish this, use the data availability and reliability assessment framework annexed to the technical note on evaluation matrix.Specify the integration of gender into the methodological approach.
5.2. Site mapping
Provide information about how the team has selected the intervention sites to be visited during fieldwork. Include the geographic coverage of the intervention and explain the sampling for the selection of areas to be visited (selection criteria to be made explicit).
Inception Report template Version November 2015 6 | P a g e
Provide information about the number of beneficiaries and key partners or stakeholders in each site. Information on how men, women, boys and girls will be appropriately and proportionately represented by the sample of field sites to be visited should also be included.
5.3. Data Collection Methods and Tools
Include description of data collection and analysis methods to be applied in the evaluation. Specify both qualitative and quantitative methods, including participatory approaches where feasible. Explain their specific application within the evaluation matrix, particularly in relation to the data sources available.
Describe:
The nature of data/information collection methods. Highlight their comparative advantage, inherent constraints and solutions to address them.
The chosen methods should be explicitly linked to the Evaluation Matrix and be informed by the stakeholder analysis as well as by an analysis of the reliability and completeness of the data collected during the design and inception phases (secondary data, M&E information, previous evaluations, etc.) - see TN on Methods
In summary, the data collection tools (Actual tools should be presented in annexes).
How the methodology will be gender-responsive, including what data collection methods will be employed to seek information on gender issues and to ensure the inclusion of women and other marginalised groups.
How data collection activities will be undertaken in a gender-sensitive manner.
Any limitations with regards to the gender-responsiveness of the chosen approach.
How validity and reliability of data collection and analysis will be ensured, including methods for triangulation.
How data will be checked and cleaned, where relevant
5.4. Limitations and risks
Describe any limitations to address the evaluation questions in view of data availability and explain how methodology proposed will mitigate the limitations. Identify the risks to the evaluation and how the team proposes to overcome them.
Inception Report template Version November 2015 7 | P a g e
This may include limitations/risks anticipated in the evaluation due to availability of data, timing of field visits, etc. Provide an explanation of how the evaluation team will manage and mitigate within these limitations/risks and/or their implications for the evaluation process and reporting.
[Describe limitations of methods and approach here, proposed mitigation measures and implications]
5.5. Ensuring quality
Describe the quality assurance mechanisms that will be applied on the evaluation process and product to ensure the credibility, independence and utility of the evaluation.
[Description of quality assurance mechanisms]
6. Organization of the evaluation
Include the key components of the evaluation’s organization including the team composition, the workplan, the Phases of the evaluation, including timing and duration of data collection and analysis, and indicate what support, if any, will be needed from WFP.Length: up to 6 pages
6.1. Team composition and workplan
Describe the expertise of each team member in line with TOR requirements, and how their skills are complementary. Include gender expertise
Specify respective roles and responsibilities for each team member Describe how the team will work together during the implementation of
the evaluation, to ensure a co-ordinated approach
[Briefly describe team composition and complimentary of skills. Summarise the roles and responsibilities in table 2]
Table 2: Sample Team composition and workplanTeam
MembersPrimary
RoleSpecific tasks
within the Evaluation
Deliverables Dates
Inception Report template Version November 2015 8 | P a g e
6.2. Timeline
Present the specific timeline, revised if appropriate from the TOR, and the associated deliverables (with specific dates) linked to it. A sample timeline is provided (see below and also Evaluation Timeline Template).
Table 3: Sample Timeline
Responsible Stakeholder
Activities Key dates
Inception phase
Deliverable (e.g. Inception report)Data collection and Analysis
Deliverable (e.g. Draft Evaluation Report)
Dissemination and follow up
Deliverable (e.g. Power point presentation)
6.3. Data collection schedule
Present the schedule as discussed with the relevant WFP Office for feasibility.
The list of proposed stakeholders to be met and sites to be visited is informed by stakeholder analysis and site mapping and should be balanced to demonstrate impartiality
Include a detailed plan in an Annex. Table 4: Sample mission schedule
Days/dates Team member Locations/sites Stakeholders
Inception Report template Version November 2015 9 | P a g e
6.4. Support/Information required
[Indicate what support (logistical/operational) and information will be required from WFP staff and other stakeholders as appropriate, based on what is available as at the time of preparing the inception report]
Inception Report template Version November 2015 10 | P a g e
Annexes
Annex 1 Map
[Include a map of the area of intervention/project area here]
Inception Report template Version November 2015 11 | P a g e
Annex 2 Evaluation Matrix
Refer to the TN on Evaluation Matrix
[Include evaluation matrix]
Inception Report template Version November 2015 12 | P a g e
Annex 4 Evaluation Mission Schedule
Day Date Team leader Tools Team member 1 Tools Team member 2 ToolsWhat / Where What / Where What / Where
Inception Report template Version November 2015 14 | P a g e
Annex 5 Documents gathered
Document Type Comment / Titles & dates of documents receivedReceived
- Y/N (N/A)
Link to Evaluation matrix
Project related documents [if applicable]Appraisal mission reportProject document (including Logical Framework in Annex)Standard Project ReportsBudget RevisionsNote for the record (NFR) from Programme Review Committee meeting (for original operation and budget revisions if any)Approved Excel budget (for original intervention and budget revisions if any)Intervention/Project Plan (breakdown of beneficiary figures and food requirements by region/activity/month and partners)Other
Country Office Strategic Documents (if applicable)
Country Strategy Document (if any)Other
Assessment Reports [if applicable]Comprehensive Food Security and Vulnerability AssessmentsCrop and Food Security Assessments (FAO/WFP)Emergency Food Security AssessmentsFood Security Monitoring System BulletinsMarket Assessments and BulletinsJoint Assessment Missions (UNHCR/WFP)
Inception Report template Version November 2015 15 | P a g e
Inter-Agency AssessmentsRapid needs assessmentsCash and voucher feasibility studiesOther
Monitoring & Reporting (if applicable)M&E PlanCountry Situation Report (SITREP) Country Executive BriefFood Distribution and Post-distribution Monitoring ReportsMonthly Monitoring ReportsBeneficiary Verification ReportsDonor specific reportsOutput monitoring reports (if applicable)
Actual and Planned beneficiaries by activity and district/ location by yearMale vs. Female beneficiaries by activity and district/ location by yearBeneficiaries by age groupActual and Planned tonnage distributed by activity by yearCommodity type by activityActual and Planned cash/voucher requirements (US$) by activity by year
Operational documents (if applicable)Organigram for main office and sub-officesActivity GuidelinesMission ReportsPipeline overview for the period covered by the evaluationLogistics capacity assessment
Inception Report template Version November 2015 16 | P a g e
Partners (if applicable)Annual reports from cooperating partnersList of partners (Government, NGOs, UN agencies) by location/ activity/ role/ tonnage handledField level agreements (FLAs), Memorandum of Understanding (MOUs)
Cluster/ Coordination meetings (if applicable)
Logistics/Food Security/nutrition cluster documents NFRs of coordination meetingsOther
Evaluations/ ReviewsEvaluations/ reviews of past or on-going operation
Resource mobilisation (if applicable)Resource SituationContribution statistics by monthResource mobilization strategyNFRs Donor meetings
Maps (if applicable)Operational MapLogistics MapFood/Cash/voucher Distribution Location MapFood Security Map
Other documents collected by the team (including external ones) (if applicable)
SpecifySpecifySpecifySpecify
[Amend as appropriate]
Inception Report template Version November 2015 17 | P a g e