knip.gos.pk · web viewkarachi dominates the economic and demographic landscape of sindh province....

Karachi Neighborhood Improvement ProjectMonitoring & Evaluation Consultant

Terms of Reference1. Project Background

Karachi dominates the economic and demographic landscape of Sindh Province. The city is the economic hub of the country, contributing around 15 percent to the national GDP. The city’s population grew from 11.3 million in 1998 to an estimated 22-24 million today, primarily through migration. This has led to significant changes in the ethnic composition of the city, with major impacts on politics, social fabric, and governance.

In 2015-2016, the World Bank (WB) prepared a Karachi City Diagnostic (KCD), an unprecedented endeavor to collect comprehensive data on the city’s economy, livability, and key urban infrastructure. The KCD provides an overview of the challenges and opportunities facing the Karachi Metropolitan Region and estimates investment levels needed to bridge the infrastructure gap and improve the metropolitan region’s economic potential. The findings and recommendations of the Diagnostic were corroborated by an extensive series of stakeholder consultations involving government counterparts, civil society and academia, the private sector, and women’s groups. These consultations emphasized the need for a sustained and long-term engagement to support the city’s transformation.

The KCD estimated that at least US$9 billion will be needed in the next 10 years to close the city’s infrastructure gaps. Karachi is one of the least livable cities in the world, performing poorly on all indicators of municipal services and dimensions of livability, health, environment, safety, and education.

The KCD suggested that the city’s needs and challenges must be framed within its complex political and social landscape. In this context, transforming Karachi into a livable, inclusive, resilient, and productive megacity cannot be achieved through any single project or intervention. In light of the depth and scale of the city’s challenges (in term of policy reforms, institutional governance, and infrastructure needs) and the Bank’s renewed involvement in Karachi, a dual-track approach for Bank engagement has been discussed and agreed on with the relevant Government tiers. Therefore, the proposed project serves as a strategic entry point for reengagement by the Bank and a building block for a long-term partnership in Karachi.

2. Project DescriptionThe development objective of Karachi Neighborhood Improvement Project for Pakistan is to enhance public spaces in targeted neighborhoods of Karachi and improve the city’s capacity to provide selected administrative services.

The project comprises three components:

1) Public Spaces and Mobility Improvement in Selected Neighborhoods.2) Support to Improved Citizen Services and City Capacity Development.3) Support to Implementation and Technical Assistance.

The first component, Public Space and Mobility Improvements in Selected Neighborhoods, aims to enhance the usability, safety, and attractiveness of public spaces; improve mobility and pedestrian access to key destinations; and improve traffic safety in public spaces in three targeted neighborhoods of Saddar downtown area, Malir, and Korangi. This component is divided into three sub-components as follows:

ToRs for M&E Consultant - KNIP of 14

(i) Saddar Downtown Area Revitalization; (ii) Malir Area Road and Public Spaces Enhancement; and (iii) Korangi Neighborhood Mobility Improvements.

The second component, Support to Improved Administrative Services and City Capacity Development, aims to improve selected administrative services to ease doing business in Karachi, lay the foundations for better city management, and support the sustainability of Component 1 investments. This component is divided into two sub-components as follows:

(i) Automation of construction permits and business registration in Karachi; and(ii) Laying the foundation for better city management.

The third component, Support to Implementation and Technical Assistance, will finance technical assistance and advisory services to the project implementation unit (PIU) and the Karachi Transformation Steering Committee (KTSC), including project management and coordination costs associated with project implementation; consultancy services for feasibility, conceptual, and detailed designs, safeguards instruments for subprojects, and the preparation of follow on operations; and‐ consultancy services for the preparation of a study on parking management in Saddar downtown.

The Project was approved on 15 June 2017 and will be closed on 30 November 2021. The total cost of the Project is US$ 98 million.

3. Consultancy Objective

The objective of this Consultancy is to assist KNIP to track implementation progress, implementing agency performance and results, to enable them to track physical and financial progress of the Project.

The Consultancy will enable monitoring activities and evaluating performance of the Project Activities during the project duration and provide the inputs for the Result Framework (Annexure I) which includes Project Activity Indicator, Baseline Indicator, End-Target, Data Source/ Methodology and Responsibility for Data Collection.

4. Scope of Work

1. The Consultant will put in place the necessary mechanisms in coordination with KNIP-PIU to develop Comprehensive M&E Framework and Project Monitoring Information System (PMIS) for collecting field data for mid-term and end of project impact evaluation.

2. The Consultant will develop a robust methodology for calculating/measuring the indicators in Result Framework (Annexure-I).

3. The Consultant will prepare a baseline for various indicator as indicated in Annexure-I in order to have a meaningful impact evaluation at the later stage.

4. The PMIS shall enable the stakeholders to access and view the necessary Project Progress, Monitoring and Evaluation Reports through KNIP-PIU website.

5. The M&E Consultant shall also develop tools for data collection and evaluation. This shall include presentation of data in a meaningful and easily comprehensible format.

6. The consultant shall monitor and evaluate the physical progress of the project on an ongoing basis, and all the project areas must be monitored. Specific areas to cover are to:

o Develop monitoring plan that will include specific indicators and parameters for site visits and facilitation as well as for assessing project progress;


o Implement the Monitoring Plans developed;o Ensure to have qualified staff to perform project site visits;o Continuously cross check the milestones achieved with the ones agreed in the contracts;o Provide timely, relevant and verified project level information to the PD, PIU (KNIP); o Regularly meet with the Project team when required to update them on the progress,

findings, and challenges faced by the Project, and provide recommendations where necessary to improve project implementation;

o Progress against agreed work plans and deliverables.

7. The M&E Consultant shall periodically evaluate and map the physical progress of the project activities with expenditure billed by the Project Construction Consultants based on the completion stage.

8. The M&E Consultant during monitoring the project performance and impact will also closely monitor and assess the environmental and social management plans (ESMPs), resettlement action plans (RAPs) and gender action frameworks, during and after construction.

9. The M&E Consultant shall perform Mid-Term Evaluation of the project to ascertain the outcome, success level and impact of the project on stakeholders, based on the indicators listed in the Results Framework (Annex 1). The periodic Evaluation and Impact Assessment Reports shall also include Beneficiary Perception Survey.

10. The M&E Consultant shall document and disseminate lessons learned from project design and implementation, to support ongoing adjustments and corrections in sub-project design.

5. Methodology, Field Based Monitoring and Verification of Project Performance and Outcomes:

1. M&E Consultant should consider setting out in their proposal areas such as an outline scope of work; methodology for data collection; staffing arrangements; and the timing and logistics of the fieldwork. The firm is free to propose the set-up that is best suited for this assignment.

2. The range of methodologies, including quantitative and qualitative data collection methods, should be outlined by consulting firms in their proposals.

3. The M&E consultant will play the role of an independent monitor but will need to collaborate with the monitoring team to develop a clear understanding of the technical monitoring methodology of the project implementation in the field, including for works, goods and services.

4. Routinely and continuously monitor project performance, verify results and ensure accuracy of reporting, identify risks and opportunities to enhance delivery, and better understand the contribution of intermediate result indicators in achieving project objectives.

5. Monthly and quarterly reports may cover some or all the following elements, although M&E should consider what type of reporting regime would be most appropriate and how data will be best presented for the following:

o Field visits to project activities / locations to assess progress of the interventions;o Observation on field visits;o Monitoring of Interim Review Points and Milestone achievements;o Verification of data (including raw data, as appropriate); o Evidence of any multiplier effects or demonstration effects associated with the project;o Analysis of the upstream and downstream benefits of project activities, including trends in

economic growth and impacts of increased employment;


o A rolling assessment of the key risks and opportunities and provide recommendations for enhancing project performance.

6. The M&E will ensure that the structure and content of technical reports is conducive to informing decision-making in a timely manner, enhancing project performance, and mitigating risks. Reports should also identify lessons learned for the monitoring components, and for future project activities design if any.

6. Context Monitoring and Analysis

1. The context monitoring and analysis will be important in generating both quantitative and qualitative data to feed into the independent evaluation of the project.

2. The evaluation will analyze the change processes linking outcome to impact and assess the degree of change that can be attributed to the project.

3. Reports should include an analysis of trends / change over time in the above, including interpretation of the information gathered in a digestible format, lesson learning, and recommendations on changes to design and delivery as required. An assessment should be made of risks to delivery (including bottlenecks and gaps) and opportunities.

7. Team Composition:

Key staff positions are tabulated below. Consulting firms should assess the non-key positions as deemed suitable in accordance with their proposed methodologies:

S/No. Position No. of Staff

i. Team Leader / Monitoring & Evaluation Specialist 1

ii. MIS & GIS Specialist 1

iii. Design, Engineering & Construction Monitoring Specialist 1

iv. Environment Health & Safety (EHS) Monitoring Specialist 1

v. Social Safeguards, Gender & Re-settlement Monitoring Specialist 1

vi. Data Collection Specialist 1

8. Qualification and Experience of the Key Staff:The key staff team members should possess relevant expertise and skills to carry out monitoring and evaluation, recommended to be inclusive of resources that will combine skills of project management, data collection, data entry, data verification, data analysis, and reporting.

Team Leader / Monitoring & Evaluation Specialist: ToRs for M&E Consultant - KNIP of 14

Master’s Degree in Project Management, Urban & Regional Planning or other relevant qualifications with a minimum of 10 years M&E related experience, preferably involving international donors. Extensive knowledge of monitoring and evaluation methodologies i.e. both quantitative and qualitative data collection, processing and analysis; Proven experience and skills in developing monitoring, evaluation and research protocols and tools with demonstrated skills and experience in developing tools for community based participatory monitoring. Proven record of leading multi-disciplinary teams in meeting monitoring and evaluation deliverables.

MIS & GIS Specialist: A degree in MIS/IT or in a related technical field is required. Minimum of 8 years of relevant working experience, including experience in developing online MIS system. Experience with Geographic Information Systems (GIS) and Information Management Systems applications for monitoring of urban development projects is required. Experience with database applications (Access, SQL) is a plus. Proven experience in data management and analysis.

Design, Engineering & Construction Monitoring Specialist:A degree in Civil or Structural Engineering, Architecture or relevant technical subjects is required. Minimum 8 years of professional experience in the relevant field of civil engineering, especially in preparation of construction technical documentation and in supporting the design and execution of baseline surveys in the project areas and developing project indicators. Have proven ability to develop simple reporting formats to be used in collecting data, and training staff in the monitoring and evaluation system of the project.

Environment Health & Safety (EHS) Monitoring Specialist:A degree, preferably in the field of environmental or social sciences with a minimum of 8 years of relevant work experience, preferably involving international donors. Proven experience in monitoring, evaluation, performance management/monitoring and reporting in development projects or programs.

Social Safeguards, Gender & Re-settlement Monitoring Specialist:A degree, preferably in the field of social sciences with a minimum of 8 years of relevant work experience, preferably involving international donors and proven track record in working on projects covering a broad range of resettlement and social development, with a strong focus on gender sensitivity. Proven experience in working with safeguard principles, developing and/or implementing social safeguard strategies for organizations or projects; and sound knowledge of working on GRM systems.

Data Collection Specialist:A degree in Computer Science/IT or in a related technical field is required. Minimum of 5 years of work experience in database design or database administration, data management and data analysis. Proven ability to use databases i.e. entering data, updating records and fields, and to design the structure of the database and write appropriate interfaces for data entry and for ensuring data quality and security.


9. Deliverables, Reporting Requirements and ScheduleThe Consultant will produce the deliverables in formats acceptable to PIU, KNIP under the following schedule (see table). Reports would be prepared initially in draft and finalized within two weeks following receipt of comments from PIU, KNIP; these would generally be provided within one week of receipt of the draft report. All documentation and outputs will also be provided in soft copy digital format (including spreadsheets, databases, GIS, etc.), suitably protected and accessible on a restricted hierarchy basis:

S No. Deliverable DescriptionSchedule (from commencement of the Contract)

1. Inception Report

- Brief description of proposed M&E System for KNIP.

- Provide detailed M&E Framework, Methodology along with the Annual M&E Plan with baseline.

- Timelines for field work and deliverables.- Reporting mechanism, formats and templates

for periodic reports.- Perform Risk Assessment and prepare

Mitigation Plan. - Final M&E team structure and manhours.

1 Month

2. Project Monitoring Information System

- Develop a comprehensive and robust PMIS for data collection and evaluation.

- Ensure access of M&E reports through KNIP website to project stakeholders.

- Work Plan detailing how the project will be implemented with realistic timelines, activities schedule, budget estimate, schedule of tasks to be carried out by key staff and support staff, third party.

- Monitoring and Evaluation strategy.- Data sources and data collection mechanisms

for each indicator outlined in results framework.

- Reporting format (based on excel/ management information system/ other format most suitable for data reporting).

- Sampling technique and sampling size for

3 Months


S No. Deliverable DescriptionSchedule (from commencement of the Contract)

impact evaluation.- Control area for impact evaluation.

3. Monitoring Reports

- Brief Monitoring Reports on monthly basis.- Detailed Monitoring Reports consolidating the

brief monthly reports on Quarterly Basis- Follow up of observations/ weaknesses

identified and recommendation given in prior reports.

Monthly and Quarterly Basis

4. Mid-Term Evaluation Reports

- Impact Evaluation Reports along with Beneficiary Perception Survey outlining the impact on lives and change in perception of beneficiaries.

Bi-Annually and Yearly basis

5. End of the Project Evaluation

- Impact Evaluation and Assessment Report to enumerate the outcome impact of the project investment on lives of stakeholder.

End of the Project life

10. Duration of the Proposed Services:The duration of the proposed M&E Services will be three years.

11. Reporting Responsibilities:The consulting firm will report to the Project Director, PIU (Karachi Neighborhood Improvement Project).


Annexure-I


knip.gos.pk · web viewkarachi dominates the economic and demographic landscape of sindh province....

Documents