implementation completion and results...

27
Document of The World Bank FOR OFFICIAL USE ONLY Report No: IMPLEMENTATION COMPLETION AND RESULTS REPORT < TF 014121> ON A SMALL GRANT IN THE AMOUNT OF USD(1.285) MILLION TO THE Royal Government of Bhutan FOR Improving Resilience to Seismic Risk (P144054) { December 3, 2018} Social, Urban, Rural And Resilience Global Practice South Asia Region Public Disclosure Authorized Public Disclosure Authorized Public Disclosure Authorized Public Disclosure Authorized

Upload: others

Post on 14-Apr-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

Document of

The World Bank FOR OFFICIAL USE ONLY

Report No:

IMPLEMENTATION COMPLETION AND RESULTS REPORT

< TF 014121>

ON A

SMALL GRANT

IN THE AMOUNT OF USD(1.285) MILLION

TO THE

Royal Government of Bhutan

FOR

Improving Resilience to Seismic Risk (P144054) { December 3, 2018}

Social, Urban, Rural And Resilience Global Practice

South Asia Region

Pub

lic D

iscl

osur

e A

utho

rized

Pub

lic D

iscl

osur

e A

utho

rized

Pub

lic D

iscl

osur

e A

utho

rized

Pub

lic D

iscl

osur

e A

utho

rized

Page 2: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

Regional Vice President: Hartwig Schafer

Country Director: Qimiao Fan

Senior Global Practice Director: Ede Jorge Ijjasz -Vasquez

Practice Manager: Christoph Pusch

Task Team Leader(s): Dechen Tshering

ICR Main Contributor: Dechen Tshering

Page 3: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

ABBREVIATIONS AND ACRONYMS

DDM Department of Disaster Management

DES Department of Engineering Services

DGM Department of Geology and Mines

DOC Department of Culture

ICR Implementation Completion and Results Report

PHRD Japan Policy and Human Resources Development

RGOB Royal Government of Bhutan

TA Technical Assistance

Page 4: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

TABLE OF CONTENTS

DATA SHEET ....................................................................... ERROR! BOOKMARK NOT DEFINED.

I. PROJECT CONTEXT AND DEVELOPMENT OBJECTIVES ....................................................... 4

II. OUTCOME ...................................................................................................................... 5

III. KEY FACTORS THAT AFFECTED IMPLEMENTATION AND OUTCOME ................................ 11

IV. BANK PERFORMANCE, COMPLIANCE ISSUES, AND RISK TO DEVELOPMENT OUTCOME .. 11

V. LESSONS LEARNED AND RECOMMENDATIONS .............................................................. 12

ANNEX 1. RESULTS FRAMEWORK AND KEY OUTPUTS ........................................................... 14

ANNEX 2. PROJECT COST BY COMPONENT ........................................................................... 21

ANNEX 3. RECIPIENT, CO-FINANCIER AND OTHER PARTNER/STAKEHOLDER COMMENTS ...... 22

ANNEX 4. SUPPORTING DOCUMENTS (IF ANY) ..................................................................... 23

Page 5: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 1 of 23

DATA SHEET

BASIC INFORMATION

Product Information

Project ID Project Name

P144054 Improving Resilience to Seismic Risk

Country Financing Instrument

Bhutan Technical Assistance Loan

Original EA Category Revised EA Category

Not Required (C) Not Required (C)

Organizations

Borrower Implementing Agency

Royal Government of Bhutan

Department of Geology & Mines, Ministry of Economic

Affairs, Department of Engineering Services, Ministry of

Works & Human Settlementt, Department of Culture,

Ministry of Home & Cultural Affairs, Department of

Disaster Management, Ministry of Home & Cultural

Afairs

Project Development Objective (PDO) Original PDO

The objective of the Project is to improve the understanding of earthquake risk in Bhutan as well as opportunities and challenges associated to its mitigation.

Page 6: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 2 of 23

FINANCING

FINANCE_T BL

Original Amount (US$) Revised Amount (US$) Actual Disbursed (US$)

Donor Financing

TF-14121 1,285,500 1,285,500 1,285,500

Total 1,285,500 1,285,500 1,285,500

Total Project Cost 1,285,500 1,285,500 1,285,500

KEY DATES

Approval Effectiveness Original Closing Actual Closing

04-Feb-2013 23-May-2013 30-May-2017 31-Jul-2017

RESTRUCTURING AND/OR ADDITIONAL FINANCING

Date(s) Amount Disbursed (US$M) Key Revisions

15-May-2017 1.14 Change in Loan Closing Date(s) Change in Implementation Schedule

KEY RATINGS

Outcome Bank Performance M&E Quality

Satisfactory Satisfactory Substantial

RATINGS OF PROJECT PERFORMANCE IN ISRs

No. Date ISR Archived DO Rating IP Rating Actual

Disbursements (US$M)

01 27-Aug-2013 Satisfactory Satisfactory 0.17

02 21-Apr-2014 Satisfactory Satisfactory 0.17

03 26-Jan-2015 Satisfactory Moderately Satisfactory 0.22

04 10-Aug-2015 Satisfactory Moderately Satisfactory 0.43

Page 7: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 3 of 23

05 25-Jul-2016 Satisfactory Moderately Satisfactory 0.74

06 16-Aug-2016 Moderately Satisfactory Moderately Satisfactory 0.81

07 01-May-2017 Moderately Satisfactory Moderately Satisfactory 1.13

ADM STAFF

Role At Approval At ICR

Regional Vice President: Philippe H. Le Houerou Hartwig Schafer

Country Director: Robert J. Saum Qimiao Fan

Senior Global Practice Director: Ede Jorge Ijjasz-Vasquez

Practice Manager: Bernice K. Van Bronkhorst Christoph Pusch

Task Team Leader(s): Augustin Maria Dechen Tshering

ICR Contributing Author: Dechen Tshering

Page 8: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 4 of 23

I. PROJECT CONTEXT AND DEVELOPMENT OBJECTIVES

Context Bhutan’s location in the eastern Himalayas, where the Indian and Eurasian plates collide makes Bhutan highly exposed to seismic risk. The two earthquakes of 2009 and 2011 with magnitudes 6.1 and 6.9 respectively had severe impacts across the country resulting in losses of US$52 million and US$24.46 million. Hundreds of houses, public buildings including critical infrastructure and cultural heritage structures were damaged. Recent research shows that after its last major earthquake of M7.5-8.5 in 1714, Bhutan could experience an earthquake of magnitude over M8 with shallow hypocenter depths ranging from 10-15 km. In response to the two recent earthquakes, the project on Improving Resilience to Seismic Risk was formulated in 2012 to enhance the capacity of the Royal Government of Bhutan (RGOB) to reduce seismic risk. This Improving Resilience to Seismic Risk project of US$1.2855 million, funded entirely by the Japan Policy and Human Resources Development (PHRD) Technical Assistance (TA) Program to Support Disaster Reduction and Recovery, has been successful in achieving the Project Development Objective. The purpose of this ICR is to present how the project achieved its objective, how the success of the project has been measured, its developmental impacts, challenges during the project implementation, and lessons learned from the project.

Project Development Objectives (PDOs) The development objective of the project – and therefore of the trust fund – was to improve the understanding of earthquake risk in Bhutan as well as opportunities and challenges associated to its mitigation.

Key Expected Outcomes and Outcome Indicators The key results indicators consist of the following: (i) Creation of a database with available information on earthquake hazard in the country. (ii) Structural vulnerability assessments carried out at the district level with hands-on training for an inter-

department engineering task force as training of trainers. (iii) Five public buildings retrofitted with hands-on training for local engineers. (iv) Development of guidelines for new construction and strengthening of existing traditional buildings.

Components The “Improving Resilience to Seismic Risk Project” had five project components with four implementing agencies contributing to improving data synthesis for seismic hazard mapping and enhancing engineering capacity to improve seismic resilience of non-engineered buildings. There were no changes to the components. Component 1: Investigations and Mapping for Improved Understanding of Seismic Risk (US$290k) The Department of Geology and Mines (DGM) under the Ministry of Economic Affairs implemented this component. Component 2: National Vulnerability Assessment and Retrofitting (US$550k) The Department of Engineering Services (DES) under the Ministry of Works and Human Settlements implemented this component. Component 3: Improving Seismic Resilience of Traditional Bhutanese Buildings (US$200k) The Department of Culture (DOC) under the Ministry of Home and Cultural Affairs implemented this component.

Page 9: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 5 of 23

Component 4: Development of Emergency Structural Assessment Capacity (US$50k) The DES under the Ministry of Works and Human Settlements implemented this component. Component 5: Project Management, Monitoring and Evaluation (US$195.5k) The Department of Disaster Management (DDM) under the Ministry of Home and Cultural Affairs implemented this component.

II. OUTCOME

Assessment of Achievement of Each Objective/Outcome The project has been successful in achieving the Project Development Objective. The expected outputs were delivered with the expected quality. The activities included workshops, trainings, hands on work on site for installation of equipment and material testing and assessments. The assessment is organized around each of the project components as follows: Component 1: Investigations and Mapping for Improved Understanding of Seismic Risk implemented by the Department of Geology and Mines (DGM) under the Ministry of Economic Affairs implemented this component. The objective of this component was to create an integrated platform at the DGM for information on seismic activities. Six seismic stations were constructed, and seismic sensors installed in Samdrup Jongkhar, Samtse, Thimphu, Trashigang, Bumthang and Gelephu, and 20 earthquake intensity meters installed in all 20 districts. This equipment is now connected to the Central Observatory System for seismic stations for Bhutan National Earthquake Monitoring Network established at the DGM also through the project. Furthermore, a Geo-science information system has been established at the DGM mainly for storing historical information on studies carried out on geohazards till date.

Original PDO and Intermediate

Results Indicators

Achievement of

indicators

Publications / Workshops

Quality, Presentation and Dissemination

Rating

PDO Indicator 1: Creation of the database with available information on earthquake hazard in the country Intermediate Results Indicators 1: Construction of six seismic monitoring stations

Achieved Achieved

1. Workshop on Understanding Seismic Hazard and Ongoing Risk Reduction Initiatives in Bhutan (Nov 22-23, 2016)

The workshop was well attended and received by various stakeholders including representatives from the government agencies, engineering college and experts from Norwegian Seismic Array, National Research Institute for Earth Science and Disaster Resilience in Japan and experts from the region. The workshop was a building block to strengthen the working relation between DGM and the other institutes to enhance its research activities.

Satisfactory

Component 2: National Vulnerability Assessment and Retrofitting implemented by the Department of Engineering

Page 10: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 6 of 23

Services (DES) under the Ministry of Works and Human Settlements. The objective of this component was to build capacity and provide tools for the Bhutanese Engineering community to improve seismic resilience of buildings. Guidelines on structural vulnerability assessment and retrofitting of load bearing structures were developed and trainings were rolled out to engineers from all the 20 districts. Retrofitting works were carried out on four selected public buildings to pilot the guidelines developed. The number of buildings to be retrofitted was reduced to four from the initially planned five since the consultancy fee for assessment and design was higher than the initial estimate. The retrofitting works were carried out at the following locations.

• Wangduephodrang - 1 storied adobe building used as a library in Tencholing School

• Gelephu - 2 storied brick masonry with reinforced cement concrete (RCC) columns used as Sports Association Building

• Samtsi - 2 storied stone masonry in cement mortar used as Renewable Natural Resources center in Yoeseltsi

• Thimphu – 1 storied stone masonry with mud mortar used as classroom of Gidagom Primary School

Original PDO and

Intermediate Results

Indicators

Achievement of indicators

Publications / Workshops

Quality, Presentation and Dissemination

Rating

PDO Indicator 2: Development of structural vulnerability assessment guidelines PDO Indicator 3: Five (revised to four) Public buildings retrofitted with hands-on training for local engineers Intermediate Results Indicators 2: Inventory of representative building typologies completed in 20 districts.

Achieved Achieved Achieved. An inventory of representative building typologies was completed in 10 out of the total 20 districts. As a result of this, a template was formulated to collect information on the building typologies all across the country and include them in the National Population and Housing Census conducted from May 30 to June 1, 2017. The

1. Retrofitting manual for Load Bearing Structures

2. Vulnerability assessment guidelines for load bearing structures

Trainings were rolled out for engineers, architects and masons from all 20 districts and 4 thromdes. 1. Three trainings on

retrofitting - 103 engineers and 42 technicians trained

2. Three trainings on earthquake vulnerability assessment – 86 engineers

3. Training of engineers on the use of Non-Destructive Testing tools - 14 engineers

The quality of the trainings was satisfactory, and these trainings proved very important to introduce the concept of retrofitting to the district engineers which is a new approach. The trainings have capacitated the district engineers to

Satisfactory

Page 11: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 7 of 23

National Statistics Bureau which led the Census survey will share the data with DES once compiled after endorsement of the information by its management.

carry out vulnerability assessments which is one of the priority activities for DES.

Component 3: Improving Seismic Resilience of Traditional Bhutanese Buildings implemented by the Department of Culture (DOC) under the Ministry of Home and Cultural Affairs. The objective of this component was to improve the general understanding of the existing construction technologies for rammed earth buildings and pilot strategies for improving the seismic resilience of these buildings. Rammed earth buildings in four selected villages in Punakha, Paro and Wangdue districts were documented and field tests on rammed earth models were conducted. Based on these field tests, the General Guidelines for improved earthquake resilient construction techniques for rammed earth structures in Bhutan were prepared. Also, a round table of experts was held for reconstructing the Wangduephodrang Dzong which led to designed and integrated seismic resilient features in the dzong reconstruction.

Original PDO and Intermediate

Results Indicators

Achievement of

indicators

Publications / Workshops

Quality, Presentation and Dissemination

Rating

PDO Indicator 4: Development of guidelines for new construction and strengthening of existing traditional buildings Intermediate Results Indicators 3: Survey of rammed earth buildings

Achieved Achieved

1. Proceeding for the Workshop on Structural issues related to traditional Bhutanese buildings, especially dzongs

2. General Guideline for improved seismic resilient construction techniques for rammed earth structures in Bhutan

3. Study of typology of Bhutanese

1. A 5-day workshop with participation of local and international participants was held at the Reconstruction of Wangduephodrang Dzong site in January 2015 based on which the proceeding was prepared. The findings from the workshop were presented to the higher authorities and have provided significant inputs to the design of the reconstruction of the Wangdue dzong. This workshop was very technical, and the quality was highly satisfactory with resource persons of highly skilled international and local experts. It also helped the department to highlight the

Satisfactory

Page 12: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 8 of 23

rammed earth buildings

importance of their work at this site and enabled them to hire an international expert to introduce high-tech seismic resilient features in the construction.

2. 54 engineers and architects were trained on seismic resilient design and construction of traditional rammed earth buildings from 20 districts. These trainings helped the department to disseminate the findings from their work to the district engineers for implementation at the field level.

Component 4: Development of Emergency Structural Assessment Capacity implemented by the DES under the Ministry of Works and Human Settlements. This component’s objectives were to develop a format suitable for assessing the various typologies of buildings in Bhutan and to build up local engineer’s capacity to assess these building in a disaster aftermath. The DES team finalized and published a Field manual for evaluating buildings’ safety post-earthquake and 54 engineers from all 20 districts received training.

Original PDO and Intermediate Results

Indicators

Achievement of

indicators

Publications / Workshops

Quality, Presentation and Dissemination

Rating

There was no results indicator associated with this component

Not Applicable

1. Field manual: Post earthquake safety evaluation of buildings

1. Three trainings conducted on post-earthquake building safety evaluation – 86 engineers

The quality of the trainings was satisfactory, and it was used as a means to introduce the manual for post-earthquake assessment to engineers from all districts to be used for the next disaster.

Satisfactory

Component 5: Project Management, Monitoring and Evaluation (US$195.5k) The Department of Disaster Management (DDM) under the Ministry of Home and Cultural Affairs implemented this component.

Page 13: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 9 of 23

This component’s objective was to support the overall coordination and implementation of the project. The DDM developed a manual on Non-structural Mitigation for schools and piloted it in two schools in the eastern part of the country. DDM also developed an Earthquake Contingency Plan for Thimphu Thromde and consequently bought basic Search and Rescue equipment for the Thromde.

Original PDO and Intermediate

Results Indicators

Achievement of

indicators

Publications / Workshops

Quality, Presentation and Dissemination

Rating

There was no results indicator associated with this component

Not Applicable

1. Manual on Non-structural Mitigation (NSM) for Schools

2. Workshop on Disaster Risk Reduction for Governors, Mayors and Police Superintendents

3. Thimphu Thromde Contingency Plan

1. Pilot training on NSM – 91 teachers from 89 schools in Trashigang and Samdrup Jongkhar were trained This training was very well received by the education sector. After the training, a few schools have initiated to buy the materials and put in place non-structural measures.

2. 36 high level officials which include Governors, Mayors and Police Superintendents participated in the workshop on Disaster Risk Reduction This workshop has enabled DDM to coordinate with various agencies for all aspects of DRM.

Satisfactory

Overall Outcome Rating

The overall outcome of the project is Satisfactory. The Trust Fund project achieved its intended results indicators within the stipulated period except for one contract which was successfully completed with an extension of 2 months (Achievement of the PDO was rated as Moderately Satisfactory during a number of supervision missions due to delays in that contract, but the work was completed successfully in the end). All expected outputs from the five project components were also achieved. There were no audit issues and the project has been closed successfully with full disbursement of funds.

Page 14: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 10 of 23

Other Outcomes and Impacts

This project was able to address the priorities identified during the preparation of the project to build the preliminary capacity of the country to improve its seismic resilience. The outputs and outcomes from the project have opened a number of opportunity windows for the government to build on, and to further strengthen its capacity with enhanced capacity of the implementing agencies. For example, the Central Observatory System for seismic stations for Bhutan National Earthquake Monitoring Network, connected with six seismic stations can be further expanded with additional stations and this network will enhance the understanding of seismic movements in the country to develop seismic maps with in country data. The vulnerability assessment guidelines developed for non-engineered buildings by the DES through this project can now be used to carry out the vulnerability assessment of the entire country. Similarly, the DOC is carrying out further detailed field tests on rammed earth structures based on the findings from the project. With the development of the contingency plan for the Thimphu Thromde under the project, the Thimphu Thromde is now aware of the gaps in its preparedness and will soon be taking up a simulation exercise and mock drill to be better prepared in the event of an earthquake. The Trust Fund also enhanced coordination among the technical agencies working on seismic resilience. The constant discussions among the implementing agencies improved working relations between the DGM, and the DOC and the DES, lead engineering departments in the country for traditional structures and risk reduction. This is the first step of collaboration between the technical experts from the seismic engineering and building engineering fields. During the project’s implementation, the DES took the opportunity to closely engage the Core Engineering group, which is led by the DES and includes structural engineers from all the relevant engineering agencies in the government, thereby strengthening the coordination of this group. It also helped implementing agencies to strengthen their collaborations with agencies within the country as well as agencies internationally. For the DOC, this Trust Fund provided the opportunity to initiate a Memorandum of Understanding with the College of Science and Technology to enhance research on traditional construction materials. In addition, the activities under the project helped DOC to carry forward its ongoing collaboration with the Agency for Cultural Affairs and the National Research Institute for Cultural Properties in Japan. Similarly, the DGM built on its collaboration with the National Research Institute for Earth Science and Disaster Resilience and Kyoto University in Japan for the establishment of the seismic network. The Trust Fund also laid the ground for establishing research institutes. It provided the platform for the DOC to establish the first Research Institute for Traditional Structures in the country. With the equipment bought and research carried out as a part of this project, the DOC was mandated to establish the RITS with support from the government; this is a considerable progress for this area of work. The DDM also leveraged its coordination with the district governors and mayors of municipalities through the engaging of these officials in a DRM workshop to understand basic concepts of DRM. Having local government leaders better understand DRM has supported DDM in carrying DRM activities in the local governments.

Page 15: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 11 of 23

III. KEY FACTORS THAT AFFECTED IMPLEMENTATION AND OUTCOME

The project was formulated to address the priorities after the earthquakes of 2009 and 2011. Therefore, in the preparatory stage, consultations were held to ensure the four implementing agencies prioritized and coordinated activities appropriately. Although initially it was a challenge to align the activities of the four implementing agencies which had very different mandates, it was a good arrangement to have the DDM as the coordinating agency, as it had the convening authority to bring the other agencies on board for DRM related activities. This arrangement ensured that while the technical agencies (DGM, DES and DOC) could focus on the technical works, all agencies agreed on a common vision on how the activities of each of the technical agencies contributed to the larger DRM agenda of the country. This implementation arrangement also encouraged the technical agencies to coordinate at different levels and finally it leveraged DDM to strengthen its coordination mechanism for improving the country’s seismic resilience. The project was restructured to extend its closing date from May 30, 2017 to July 31, 2017. This was the only extension of the project. This extension was required to ensure the retrofitting work at the Samtsi site was properly completed. The retrofitting works were delayed due to the contractor’s challenges in hiring technical experts at the beginning of the work. Furthermore, some construction materials in the market, such as seasoned hard wood, were unavailable during this period so this delayed the work further. The Ministry of Finance of the Royal Government of Bhutan requested the extension of closing date on April 21, 2017. The Bank approved this on May 16, 2017.

IV. BANK PERFORMANCE, COMPLIANCE ISSUES, AND RISK TO DEVELOPMENT OUTCOME

Bank Performance - The Bank carried out its role Satisfactorily. The Bank team conducted regular supervision and provided technical back stopping and guidance for both procurement and financial aspects. The team also participated in the coordination meetings to ensure proper understanding of the roles of each team which helped in the smooth implementation of the project. Compliance issues - The Recipient ensured to abide by the Grant Agreement ensuring all fiduciary compliance as per the Bank rules and regulations. Despite having to coordinate and collect financial information from four different agencies, the DDM was able to achieve 100% disbursement. The IUFRs were submitted in a timely manner, as were the external audit reports. All the intended outputs were achieved. Risk to development outcome - The likelihood of sustaining the outcomes of this Trust Fund is Significant. The outcomes in terms of enhancing the knowledge base and capacity have been embedded into existing institutions and there are plans for ongoing work by the government and with donor support. While the Royal Government of Bhutan recognizes the country’s vulnerability to seismic and hydrometeorogical hazards, an obstacle for sustained action is its financial constraints. The majority of the investments in disaster risk management are through external aid posing a challenge for the government to plan long term and larger scale investments as required. While the government’s efforts in coordinating the support from various development partners in this area is commendable, it still remains a challenge in strategically investing in DRM when implementation of plans depends on external resources.

Page 16: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 12 of 23

V. LESSONS LEARNED AND RECOMMENDATIONS

There are a number of lessons learned from this project which can be applied to projects of similar technical nature and size. The lessons learned are categorized as project design, implementation arrangement, financial management, procurement management, data availability, data and information management, technical capacity and financial resources. (i) Project design: This was one of the first projects that solely focused on seismic risk with four implementing agencies working on different aspects of seismic resilience. This allowed the implementing agencies to put in the priorities to enhance seismic resilience, and successfully achieve them. However, during implementation, it was a bit of a challenge to monitor the number of activities and immense effort was required to ensure proper coordination and linkage between the different activities even within each component. Therefore, building on the findings from this project, it is important to either plan for enhanced implementation support to overcome the challenges of complexity or reduce the number of activities. (ii) Implementation Arrangements: The project’s support is commendable in terms of enhancing the level of coordination among the implementing agencies. The Trust Fund helped to bring the seismic and building experts to come together to understand the knowledge and information gaps to enhance the understanding of seismic risk faced by the country. This discussion helped to pave a way forward for these agencies to enhance seismic information which would be essential to formulating building codes for Bhutan which currently does not have its own building codes but adopts the Indian Standard Codes. Much of the value added of these types of projects comes from facilitating dialogue and enhancing coordination. (iii) Procurement Management: While lumping contracts can facilitate procurement and contract management of small works, it is not always the most effective strategy. Both the DGM and the DES had civil works. The DGM issued separate contracts for construction of seismic stations in six locations and these were carried out in a timely manner. On the other hand, the DES lumped the contracts for retrofitting of four sites into one. There were issues in managing labour and materials at different locations by one contractor and these led to the delay in completing the works. Overall, there is a need to strengthen contract management capacity to ensure smooth implementation of the contracts for future engagements. (iv) Data availability: There is scarcity of data on local materials and traditional construction techniques to carry out vulnerability assessments of buildings. This shortcoming is due to the lack of research work and testing labs for such purposes in the country. The DES carried out sample testing from the retrofitting sites for the specific sites and the same results were used to carry out vulnerability assessments. The DES also adopted data from international data sets when not available from these sites. Therefore, while the quality of the guidelines developed through the project is of acceptable quality, the results are not fully conclusive due to the quality of data input. This scarcity of data clearly indicated the need to strengthen the research work in this area to be able to come up with better assessments that can be used for informed decision making. (v) Data and information management: There is no clear mechanism to share and store data and information. In order to promote data and information sharing which is one of the most important ways for optimum

Page 17: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 13 of 23

utilization of resources, there is a need to create a mechanism for data storing and sharing among the technical agencies. (vi) Technical capacity: There is a huge need to enhance the technical capacity of the government agencies as well as the private sector. Risk assessments and retrofitting are newly introduced to Bhutan. While the government understands the importance of these initiatives in the DRM field, the inhouse capacity of the government agencies as well as private sector is very limited. Therefore, for Bhutan where technical capacity in terms of technical training as well as numbers is limited, it would be a strategic move to improve coordination mechanism among the different technical agencies to share data and consolidate efforts so that the limited existing capacity and resources can be more efficiently deployed and serve the needs of many agencies. (vii) Financial resources: Not having guaranteed financial resources to carry out priorities outlined for a financial year limits the agencies’ capacity to plan. The agencies revise their work plan based on the budget made available at a later stage. While DRM and Climate Resilience are both priorities for the government, due to the competing demands for resources for all developmental activities, it is a challenge to sustain the outcomes from these projects. Therefore, a key aspect that should be well ingrained in the project design is capacity building and coordination mechanisms that can carry forward the outcomes from the project.

.

Page 18: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 14 of 23

ANNEX 1. RESULTS FRAMEWORK AND KEY OUTPUTS

A. RESULTS INDICATORS A.1 PDO Indicators Objective/Outcome: To create an integrated platform at the DGM for information on seismic activities

Indicator Name Unit of Measure

Baseline Original Target Formally Revised

Target

Actual Achieved at Completion

Creation of a database with available information on earthquake hazard in the country

Yes/No N Y Y Y

23-May-2013 23-May-2013 30-May-2017 31-Jul-2017

Comments (achievements against targets): A Geo-Science Information System to archive digital repository (soft copies) for geoscience information established at DGM. Objective/Outcome: To build capacity and provide tools for the Bhutanese Engineering community to improve seismic resilience of buildings

Indicator Name Unit of Measure

Baseline Original Target Formally Revised

Target

Actual Achieved at Completion

Development of structural vulnerability assessments guidelines

Yes/No N Y Y Y

23-May-2013 23-May-2013 30-May-2017 31-Jul-2017

Page 19: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 15 of 23

Comments (achievements against targets): Vulnerability assessment guidelines for load bearing structures formulated

Indicator Name Unit of Measure

Baseline Original Target Formally Revised

Target

Actual Achieved at Completion

Public buildings retrofitted with hands-on training for local engineers

Number 0.00 5.00 4.00 0.00

23-May-2013 23-May-2013 01-Jul-2014 31-Jul-2017

Comments (achievements against targets): The number of buildings to be retrofitted was reduced to four from the initially planned five since the consultancy fee for assessment and design was higher than the initial estimate. Objective/Outcome: To improve the general understanding of the existing construction technologies for rammed earth buildings and pilot strategies for improving the seismic resilience of these buildings

Indicator Name Unit of Measure

Baseline Original Target Formally Revised

Target

Actual Achieved at Completion

Development of guidelines for new construction and strengthening of existing traditional buildings

Yes/No N Y Y Y

23-May-2013 23-May-2013 30-May-2017 31-Jul-2017

Comments (achievements against targets): General Guideline for improved seismic resilient construction techniques for rammed earth structures in Bhutan formulated

A.2 Intermediate Results Indicators

Component: Investigations and Mapping for Improved Understanding of Seismic Risk

Page 20: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 16 of 23

Indicator Name Unit of Measure

Baseline Original Target Formally Revised

Target

Actual Achieved at Completion

Construction of seismic monitoring stations

Number 0.00 6.00 6.00 6.00

23-May-2013 23-May-2013 30-May-2017 31-Jul-2017

Comments (achievements against targets): Six seismic stations constructed and now connected to the Central Observatory System for seismic stations for Bhutan National Earthquake Monitoring Network established at the DGM also through the project.

Component: National Vulnerability Assessment and Retrofitting

Indicator Name Unit of Measure

Baseline Original Target Formally Revised

Target

Actual Achieved at Completion

Inventory of representative building typologies completed in 20 districts

Number 3.00 20.00 10.00 10.00

23-May-2013 23-May-2013 30-May-2017 31-Jul-2017

Comments (achievements against targets): An inventory of representative building typologies was completed in 10 out of the total 20 districts. As a result of this, a template was formulated to collect information on the building typologies all across the country and include them in the National Population and Housing Census conducted from May 30 to June 1, 2017. The DES is working with the National Statistics Bureau which led the Census survey on compilation of the data.

Component: Improving Seismic Resilience of Traditional Bhutanese Buildings

Indicator Name Unit of Measure

Baseline Original Target Formally Revised

Target

Actual Achieved at Completion

Survey of rammed earth Yes/No N Y Y Y

Page 21: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 17 of 23

buildings 23-May-2013 23-May-2013 30-May-2017 31-Jul-2017

Comments (achievements against targets): Study of typology of Bhutanese rammed earth buildings report formulated

Page 22: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 18 of 23

B. ORGANIZATION OF THE ASSESSMENT OF THE PDO

Objective/Outcome 1 - To create an integrated platform at the DGM for information on seismic activities

Outcome Indicators 1. Creation of the database with available information on earthquake hazard in the country

Intermediate Results Indicators 1. Construction of six seismic monitoring stations

Key Outputs by Component (linked to the achievement of the Objective/Outcome 1)

1. Construction of six seismic monitoring stations 2. 20 earthquake intensity meters installed in all 20 districts 3. Seismic stations and intensity meters connected to the Central Observatory System for seismic stations for Bhutan National Earthquake Monitoring Network established at the DGM 4. Geo-science information system established at the DGM 5. Workshop on Understanding Seismic Hazard and Ongoing Risk Reduction Initiatives in Bhutan (Nov 22-23, 2016)

Objective/Outcome 2 - To build capacity and provide tools for the Bhutanese Engineering community to improve seismic resilience of buildings

Outcome Indicators 1. Development of structural vulnerability assessment guidelines 2. Four Public buildings retrofitted with hands-on training for local engineers

Intermediate Results Indicators 1. Inventory of representative building typologies completed in 20 districts.

Key Outputs by Component (linked to the achievement of the Objective/Outcome 2)

1. Guidelines on structural vulnerability assessment and retrofitting of load bearing structures were developed 2. Trainings on the above guidelines were rolled out to engineers from all the 20 districts 3. Retrofitting works were carried out on four selected public buildings to pilot the guidelines developed

Page 23: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 19 of 23

Objective/Outcome 3 - To improve the general understanding of the existing construction technologies for rammed earth buildings and pilot strategies for improving the seismic resilience of these buildings

Outcome Indicators 1. Development of guidelines for new construction and strengthening of

existing traditional buildings

Intermediate Results Indicators 1. Survey of rammed earth buildings

Key Outputs by Component (linked to the achievement of the Objective/Outcome 1)

1. Proceeding for the Workshop on Structural issues related to traditional Bhutanese buildings, especially dzongs was published based on a round table of experts held for reconstructing the Wangduephodrang Dzong

2. General Guideline for improved seismic resilient construction techniques for rammed earth structures in Bhutan published

3. Study of typology of Bhutanese rammed earth buildings report published based on documentation of rammed earth buildings in four selected villages 4. 54 engineers and architects were trained on seismic resilient design and construction of traditional rammed earth buildings from 20 districts.

Objective/Outcome 4 - To develop a format suitable for assessing the various typologies of buildings in Bhutan and to build up local engineer’s capacity to assess these building in a disaster aftermath.

Outcome Indicators There was no results indicator associated with this component

Intermediate Results Indicators NA

Key Outputs by Component (linked to the achievement of the Objective/Outcome 2)

Field manual for evaluating buildings’ safety post-earthquake was finalized and published, and 54 engineers from all 20 districts were trained to use the manual.

Page 24: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 20 of 23

Objective/Outcome 5 - To support the overall coordination and implementation of the project.

Outcome Indicators There was no results indicator associated with this component

Intermediate Results Indicators NA

Key Outputs by Component (linked to the achievement of the Objective/Outcome 1)

1. Successful coordination of the project in a timely manner. 2. Manual on Non-structural Mitigation for schools developed and piloted in two schools in the eastern part of the country. 3. Earthquake Contingency Plan for Thimphu Thromde developed

Page 25: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 21 of 23

. .

ANNEX 2. PROJECT COST BY COMPONENT

Components Amount at Approval

(US$M) Actual at Project

Closing (US$M) Percentage of Approval

(US$M)

Investigations and Mapping for Improved Understanding of Seismic Risk

.29 .29 22.56%

National Vulnerability Assessment and Retrofitting

.55 .55 42.78%

Improving Seismic Resilience of Traditional Bhutanese Buildings

.20 .20

15.56%

Development of Emergency Structural Assesment Capacity

.05 .05

3.89%

Project Management Monitoring and Evaluation

.19 .19

15.21%

Total 1.28 1.28 100.00

Page 26: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 22 of 23

ANNEX 3. RECIPIENT, CO-FINANCIER AND OTHER PARTNER/STAKEHOLDER COMMENTS

The four implementing agencies commended the project in terms of its activities as well as the implementation arrangement put in place which greatly enhanced the level of coordination among the implementing agencies. It was the first time that seismic and building experts came together to understand the knowledge and information gaps to enhance the understanding of seismic risk faced by the country. The outputs achieved by the project in terms of workshops, trainings, equipment and systems developed and the publications are basic requirements in building seismic resilience, especially for developing countries with technical capacity constraints. Therefore, most of these outputs are easily scalable to improve accuracy and coverage, as well as adopted for sectors such as the health and cultural heritage within the country as well as in other countries. And this sustainability of the achievement of the project sustained through government efforts with support from other development partners is seen in a short span of time after the completion of the projects as follows: - The DGM is working with the RIMES to add 8 more seismic stations across the country. It is also

working with the Ministry of Information and Communication to improve the network stability for transfer of data and the department is developing the necessary SOPs for sharing information and communication to improve the data management system.

- The DES is working with UNDP to carry out vulnerability assessments of two districts and geo referencing of the buildings.

- JICA is building on to the outcomes of this Trust Fund with the Science and Technology Research Partnership for Sustainable Development (SATREPS) technical cooperation. This technical cooperation follows the same implementing arrangement as that of the PHRD Trust Fund with the same implementing agencies and builds on it to enhance the seismic resilience of indigenous buildings in Bhutan.

Page 27: IMPLEMENTATION COMPLETION AND RESULTS REPORTdocuments.worldbank.org/curated/en/689891544700538467/... · 2018-12-14 · Document of The World Bank FOR OFFICIAL USE ONLY Report No:

The World Bank Improving Resilience to Seismic Risk (P144054)

Page 23 of 23

ANNEX 4. SUPPORTING DOCUMENTS (IF ANY)