UDOT I-15 The Point Design-Build ProjectUsing an ‘Independent Quality Firm’ to Verify Conformance to

Contract Requirements

July 20, 2015

1

Tim Rose, PE – Utah Department of TransportationDavid Brown, PE – ParsonsMatt Wildauer, PE - Parsons

Introduction

• Project Overview• Measuring Quality and Approach to Quality Management• IQF Methodology and Reporting• Conclusions/Take-Away• Questions

2

Project Overview

3

Project scope is to reconstruct I-15 from SR-92 to 12300 South

4

Construction will be phased through two seasons

5

Complex phasing allows four lanes to be maintained in each direction

6

Phase 2 : April – June 2015 Phase 3 : June – September 2015

New pavement will be utilized for Phase 4 MOT

7Phase 4: September – November 2015

Mainline construction will extend through 2015 and 2016

8

• Independent Quality Firm is involved in the project from selection through closeout.

Goals and objectives provide focus to the project

9

Goals and objectives provide focus to the project

10

Goals and objectives provide focus to the project

11

Project Highlights

12

East Jordan Canal box culvert installation Segment 3 near Lehi

Project Highlights

13

Grading in Segment 3 Retaining wall along Pony Express Rd

Project Highlights

14

Placement of lean concrete pavement Girder setting at 14600 South bridge

Measuring Quality and Approach to Quality Management

15

Performance measurement roles depend on delivery method

16

Traditional - Project Delivery - Alternative Changing Roles & Responsibilities

DOT Maintenance

Fix the pot-hole quickly.

Ensure Quality

Design-Bid-Build

Inspect and test materials

Verify Quality

Design-Build

Design Builder follows QMP

Validate Quality

P3

Oversight of Developer

Due Diligence

Various projects use different measures of quality

• Set a high expectation – “We want a ‘high quality’ project.”• Inspect everything until it is right.• “If all the material tests pass then the work is good.”

17

To measure QUALITY – we need DATA

Quality measurement on I-15 The Point project is based on performance and conformance rates

18

# of CONFORMING observations

TOTAL # of observationsPerformance Rate =

PERFORMANCE rate CONFORMANCE rate

Conformance Rate MUST 100%

Requirements management uses verification to determine performance

• A way to measure PERFORMANCE• All Work is defined by distinct requirements.• Isolate KEY requirements – in a searchable database.• Apply attributes to requirements (risk, owner, phase, performance).• Verify requirements are fulfilled.• Update requirements in database as scope evolves.

19

The Project Management

‘Trinity’

Requirements management is a component of overall performance measurement

20

SCOPETechnical

Requirements

BUDGETDollars

SCHEDULETime

PerformanceMeasurement

Requirements management is a component of performance measurement

21

SCHEDULEManagement

Time Remaining 0%100%Th

e W

ork

BUDGETManagement

Dollars Remaining 0%100%

The

Wor

k

REQUIREMENTManagement

Requirements Remaining 0%100%

The

Wor

k

Data allows performance to be measured and reported

22

Observed Performance Rate ~97%

Acceptance Data Points

~ 1700

Similar project

in Ohio

IQF Methodology and Reporting

23

A customized database provides an efficient platform for verifying requirements

• At the beginning of the project, team will extract requirements from Contract documents, standards, and special provisions.

• This provides an organized, customizable, searchable requirement database for use by the project team.

• Requirements are updated as scope evolves.

24

Contract requirements are imported to the database at the beginning of the project

25

Requirement Description

Each applicable requirement is verified based on objective evidence

• Verifications of the design to determine conformance with Contract requirements are completed at each submittal. Requirements populated using checklists.

• Verifier provides objective evidence and location for observations on each requirement along with a result code.

26

Objective evidence is provided for each requirement verified.

Each observation is assigned a result – “C” or “RD”

Objective evidence for construction verifications are based on inspection and testing

• Construction verifications are based on inspection and testing – hard data from the field.

• Test results are referenced in objective evidence for verification.• Results that do not pass are marked as RD or NCR.

27Result Code

IQF monthly report measures and tracks project performance

• The IQF monthly report provides measurement and tracking of the design-build team’s performance on the project.

• The report presents results of verifications and tracks trends throughout the project.

• IQF staff work with the Department to capture results of Department audits in the report.

• Material testing results are gathered and summarized each month.

28

Design Discipline Latest Issue Date

RD's Opened During Reporting Period

Open RD's Carried Forward

RD's Closed During Reporting Period

RD's Remaining Open

ATMS, Lighting, Traffic Signals 5/29/2015 4 11 2 13

Drainage 5/7/2015 2 3 0 5MOT 5/14/2015 1 0 1 0

Roadway 5/20/2015 9 0 3 6Structures 5/30/2015 4 13 3 14

Utilities 5/27/2015 8 3 0 11Walls 5/20/2015 5 0 0 5TOTAL 33 30 9 54

Design performance is measured continuously and reported monthly

• Monthly design performance has ranged from 75%-89% conforming observations, with an average of 85% conforming observations.

• Conformance rate must equal 100% prior to RFC.

29

Design Performance

Jun-15 Project Average

0%

20%

40%

60%

80%

100%

86% 85%

Design Performance

Sep-14

Oct-14

Nov-14

Dec-14

Jan-15

Feb-15

Mar-15

Apr-15

May-15

Jun-15Jul-1

5

Aug-15

Sep-150

200

400

600

800

1000

1200

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

440

242 231

556

803

531

309 329 277

563

112

48 79

76

150

84

60 4333

891

22

80%83%

75%

88%84% 86%

83%88% 89% 86%

Monthly Design Performance Activity

Conforming Observations Requirement Deficiencies (Issued)Nonconformance (Issued) Monthly Performance Rate

Requ

irem

ents

Ver

ified Perform

ance Rate

Construction performance is measured and reported in a similar manner to design

• Construction performance rate is near 98% conforming.• Higher performance rate is due to larger sample size and backup of

material testing data for verifications.

30

ConstructionPerformance

Jun-15 Project Average0%

20%

40%

60%

80%

100%98% 98%

ConstructionPerformance

Sep-14

Oct-14

Nov-14

Dec-14

Jan-15

Feb-15

Mar-15

Apr-15

May-15

Jun-15Jul-1

5

Aug-15

Sep-150

200

400

600

800

1000

1200

1400

1600

1800

2000

2200

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0 640 35

447 534 926 953 1107 17801

8

17 12

16

19

1

24

7 84

12

100%95%

100% 98% 97% 98% 98% 98%

Monthly Construction Performance Activity

Conforming Observations Requirement Deficiencies (Issued)

Nonconformance (Issued) Monthly Performance Rate

Requ

irem

ents

Ver

ified

Performance Rate

Observed performance rates are similar between projects

31

Conclusion/Take-Away

• A requirements based quality program provides a comprehensive approach to quality. The process provides an opportunity to measure performance, not just progress.

• This process collects data – from design and construction – and provides objective evidence of conformance to requirements.

• Success depends on having good people with a focus on meeting requirements the first time, allowing projects to be completed with greater speed and efficiency, and saving money.

32

Questions

33