NMC METRICS COMMITTEEOCTOBER 2018

CONFIRMED

CONFIRMED MINUTESOCTOBER 23, 2018

PITTSBURGH, PENNSYVANIA, USA

These minutes are not final until confirmed by the Committee in writing or by vote at a subsequent meeting. Information herein does not constitute a communication or recommendation from the Committee and shall not be considered as such by any agency.

TUESDAY, OCTOBER 23, 2018

1.0 OPENING COMMENTS

1.1 Call to Order / Quorum Check

The Nadcap Management Council (NMC) Metrics Committee was called to order at 10:30 a.m., 23-Oct-2018.

The meeting was restricted to Committee members as well as NMC members and invited guests. Rusty Freelen and Frederic Grenon were recognized as guests.

A quorum was established with the following representatives in attendance:

Subscriber Members/Participants Present (* Indicates Voting Member)

NAME COMPANY NAME

* Latch Anguelov SAFRAN* Tomohiko Ashikaga Mitsubishi Heavy Industries* Pascal Blondet Airbus Commercial Aircraft* Richard Blyth Rolls Royce Chairperson* Daniel Calderwood BAE Systems – Air * David Cianfrini BAE Systems Inc.* Russ Cole Northrop Grumman* Timothy Ditch The Boeing Company

Rusty Freelen Lockheed Martin Corp.Frederic Grenon Bombardier

* Troy D. Grimm Spirit AeroSystems* Dave Hansen 309th Maintenance Wing* Emily Hoiles Eaton Aerospace Group* Wendy Jiang COMAC* Bob Koukol Honeywell Aerospace* Marc-André LeFebvre Heroux Devtek Inc.* Eric Lorentzen DCMA* Jeff Lott The Boeing Company* Scott Maitland UTC Aerospace (Goodrich)* Frank McManus Lockheed Martin Corp.* Roger Merriman Textron Aviation* Steven Meyer Spirit AeroSystems* Daniel Muenter Leibherr-Aerospace* Ana Ottani dos Santos Embraer S.A.* John Pfeiffer GE Aviation* Per Rehndell GKN Aerospace Sweden AB * Michael B. Roberts Gulfstream* Norberto Roiz Airbus Defence and Space* Victor Schonberger Israel Aerospace Industries* Scott Wheatley Rockwell Collins

NMC METRICS COMMITTEEOCTOBER 2018

CONFIRMED

Other Members/Participants Present (* Indicates Voting Member)

* Jim Cummings Metal Finishing Company Inc.* Johanna Lisa Continental Heat Treating/Quality Heat

Treating* Christopher Webb PCC Structurals Inc.* Wilfried Weber PFW Aerospace GmbH* Gary White Orbit Industries, Inc.

PRI Staff Present

Mark AubeleScott KlavonJimBob

LewisLizewski

Shariq ParvezGlenn ShultzJon Steffey

1.2 Safety Information was reviewed.

1.3 Code of Ethics, Anti-Trust & Conflict of Interest was reviewed by Richard Blyth.

1.4 The NMC Metrics Meeting Agenda was reviewed.

1.5 Approval of Previous Meeting Minutes

The previous meeting minutes were approved. Motion made by Jeff Lott and seconded by Scott Maitland to approve the minutes from 19-Jun-2018 as written. Motion passed unanimously.

2.0 REVIEW METRICS COMMITTEE CHARTER, CURRENT MEMBERSHIP STATUS

The attached NMC Metrics Committee Charter was reviewed.

3.0 RAIL

The attached Rolling Action Item List (RAIL) was reviewed. There were seven open action items: MCA-81, MCA-84, MCA-90, MCA-91, MCA-92, MCA-93, and MCA-94. MCA-84, MCA-90, MCA-92, MCA-93, and MCA-94 were closed during this meeting.

4.0 REVIEW NMC/BOARD OF DIRECTOR’S (BOD) METRICS

The attached BoD Metrics were reviewed. All metrics are “green”. The Metrics Committee agreed to continue using the same metric goals for 2019 as we have been using for 2018.

NMC METRICS COMMITTEEOCTOBER 2018

CONFIRMED

Also, the Equitable Participation metrics were reviewed. Letter/Approval Ballot Participation and Observation Audit Participation are red, but Auditor Interview Participation has improved and is now yellow.

The method for accounting document ballot participation was discussed at length and the proposed method was not accepted by the Metrics Committee. Jon Steffey will provide data for individuals voting on Letter/Approval ballots within task groups and the NMC that have voting members on the task group/NMC. We will continue to pilot the equitable participation metrics through 2019.

Company participation data was redacted from the attached presentation. The unredacted version can be found in the Equitable Participation section of the NMC Forums section of eAuditNet.

ACTION ITEM: Richard Blyth will propose maintaining the 2018 metric goals through 2019 to the Steering Committee for approval (Due Date: 24-Oct-2018, Completed)

ACTION ITEM: Jon Steffey will provide data for individuals voting on Letter/Approval Ballots within task groups and the NMC that have voting members on the task group/NMC. (Due Date: 18-Feb-2019)

5.0 TASK GROUP METRICS SUMMARY REVIEW [MCA-64]

Richard Blyth reported that he and Glenn Shultz have been continually reviewing the monthly task group metrics.

There were no major or repeated issues detected in the last four months. Richard and Glenn will continue to review the task group metrics monthly and request explanations for any red metrics. Metrics and summaries are located in eAuditNet under the Metrics application and in the NMC Work Area.

6.0 REVIEW SUBSCRIBER ACCREDITATION METRICS

The attached Subscriber Accreditation Committee (SAC) Metrics were reviewed. The SAC metrics were mostly green with one yellow. It was due to only three certificates being issued in the month and one of the audits had higher than normal cycle time.

7.0 POTENTIAL QUALITY METRIC UPDATE [MCA-81, MCA-93]

NMC METRICS COMMITTEEOCTOBER 2018

CONFIRMED

Richard reported that the quality metric based on non-sustaining NCRs was revised to be a ratio of non-sustaining NCRs per reaccreditation audits conducted. This was done to avoid the appearance of improvement due to an increase in major NCRs with no decrease in non-sustaining NCRs. The Metrics Committee agreed that this metric should be proposed to the Steering Committee for approval to pilot it through 2019.

ACTION ITEM: Richard Blyth will present the Quality Metric based on Non-Sustaining NCRs per Reaccreditation audits conducted to the Steering Committee for approval to pilot the metric through 2019(Due Date: 24-Oct-2018, Completed)

8.0 NADCAP EFFECTIVENESS & CUSTOMER SATISFACTION 2017 SURVEY UPDATE [MCA-84]

Russ Cole presented the final summary of the 2017 Nadcap Effectiveness and Customer Satisfaction Survey. He reported that there were a few responses to questions in the survey that were interesting and could possibly be worked but overall each of the categories on the spider chart should be rated at a level 4 or 5. Glenn will update the spider chart with these new category ratings. Glenn will also send this presentation to the leadership of the NMC Continuous Improvement Committee.

Glenn Shultz announced that the 2019 Nadcap Effectiveness and Customer Satisfaction Survey will be distributed in January 2019. Data from the 2019 survey will also be forwarded to the NMC Continuous Improvement Committee for review.

ACTION ITEM: Glenn Shultz will update the Nadcap Effectiveness and Customer Satisfaction Spider chart with a rating of 4 for each of the categories covered by the survey. (Due Date: 18-Feb-2019)

ACTION ITEM: Glenn Shultz will forward the Nadcap Effectiveness and Customer Satisfaction Survey Summary to the NMC Continuous Improvement Committee (Due Date: 18-Feb-2019)

9.0 FINDING AUDITS TO OBSERVE

Richard presented the following presentation regarding how to find audits to observe and how to register for those audits.

10.0 NADCAP UPDATE

The team reviewed Scott Klavon’s Nadcap Update presentation.

NMC METRICS COMMITTEEOCTOBER 2018

CONFIRMED

11.0 NEW BUSINESS REVIEW

No new business was raised.

12.0 NEW ACTION ITEMS

New action items were reviewed and will be added to the RAIL.

13.0 MEETING FACILITATION FEEDBACK

There were no suggestions to improve the meeting.

14.0 ADJOURNMENT – 23-OCT-2018

Meeting was adjourned at 12:02 pm (motion by Steve Meyer and seconded by Frank McManus).

Minutes Prepared by: Glenn Shultz gshultz@p-r-i.org

***** For PRI Staff use only: ******

Are procedural/form changes required based on changes/actions approved during this meeting? (select one)

YES* ☐ NO ☒

*If yes, the following information is required:Documents requiring revision: Who is responsible: Due date: