opening comments - performance review institute · web viewunconfirmed minutes june 4, 2019 paris,...

NMC METRICS COMMITTEEJUNE 2019

UNCONFIRMED

UNCONFIRMED MINUTESJUNE 4, 2019

PARIS, FRANCE

These minutes are not final until confirmed by the Committee in writing or by vote at a subsequent meeting. Information herein does not constitute a communication or recommendation from the Committee and shall not be considered as such by any agency.

TUESDAY, JUNE 4, 2019

1.0 OPENING COMMENTS

1.1 Call to Order / Quorum Check

The Nadcap Management Council (NMC) Metrics Committee was called to order at 11:30 a.m., 04-Jun-2019.

The meeting was restricted to Committee members as well as NMC members and invited guests. Florian Breyer, Delton Carter, Sheng Cheng and Stefania Dello Ioio were recognized as guests.

A quorum was established with the following representatives in attendance:

Subscriber Members/Participants Present (* Indicates Voting Member)

NAME COMPANY NAME

* Latch Anguelov SAFRAN* Tomohiko Ashikaga MITAC / MHI* Pascal Blondet Airbus Commercial Aircraft* Richard Blyth Rolls-Royce Chairperson* Craig Bowden BAE Systems – Air

Florian Breyer Liebherr-Aerospace SAS* Daniel Calderwood BAE Systems – Air

Delton Carter BAE Systems, Inc.* Jeff Cerre Textron Aviation

Sheng Cheng COMAC* Russ Cole Northrop Grumman

Stefania Dello Ioio Leonardo S.p.A Divisione Velivoli* Timothy Ditch The Boeing Company* Rusty Freelen Lockheed Martin Corp.* Gina Fuzzell Lockheed Martin Corp.* Francois-Simon Gauthier Pratt & Whitney Canada* Bob Koukol Honeywell Aerospace* Ralph Kropp MTU Aero Engines AG* Marc-Andre Lefebvre Heroux-Devtek* Jeff Lott The Boeing Company* Dan Loveless Parker Aerospace* Scott Maitland Collins Aerospace (Goodrich)* Robin McGuckin Bombardier, Inc.* Roger Merriman Textron Aviation* Steven Meyer Spirit AeroSystems* Alex Olmedo Triumph Group* Ana Ottani dos Santos Embraer S.A.* John Pfeiffer GE Aviation* Per Rehndell GKN Aerospace Sweden AB * Norberto Roiz Airbus Defence & Space* Davide Salerno Leonardo S.p.A Divisione Velivoli* Victor Schonberger Israel Aerospace Industries


UNCONFIRMED

* Lindsey Shaw Raytheon Vice Chairperson* David Soong Pratt & Whitney

Other Members/Participants Present (* Indicates Voting Member)

* Jonathan Hebben Avcorp Composite Fabrication* Johanna Lisa Continental Heat Treating/Quality Heat

Treating* Christopher Webb PCC Structurals, Inc.* Wilfried Weber PFW Aerospace GmbH* Gary White Orbit Industries, Inc.

PRI Staff Present

Mark AubeleMike HaywardJennifer KornrumpfScott KlavonJim LewisBob LizewskiIan SimpsonJon Steffey

1.2 Safety Information was reviewed.

1.3 Code of Ethics, Anti-Trust & Conflict of Interest was reviewed by Richard Blyth.

1.4 The NMC Metrics Meeting Agenda was reviewed.

1.5 Approval of Previous Meeting Minutes

The previous meeting minutes were approved. Motion made by John Pfeiffer and seconded by Roger Merriman to approve the minutes from 19-Feb-2019 as written. Motion passed unanimously.

2.0 REVIEW METRICS COMMITTEE CHARTER, CURRENT MEMBERSHIP STATUS

The attached NMC Metrics Committee Charter was reviewed.

3.0 RAIL

The attached Rolling Action Item List (RAIL) was reviewed. There were five open action items: MCA-100, MCA-101, MCA-102, MCA-103, and MCA-104.

MCA-100, MCA-101 and MCA-104 were closed during this meeting

MCA-102. Subscribers noted that the polling system being used to ascertain availability of Task Group Subscribers to perform Auditor interviews is leaving multiple entries in their schedules. Bob Lizewski asked to review further.

MCA-104. Discussed further in agenda item 8.0

Metrics Committee Charter revisited June 2019.pptx


UNCONFIRMED

4.0 TASK GROUP METRICS SUMMARY REVIEW [MCA-64]

Richard Blyth reported that he and Glenn Shultz have been continually reviewing the monthly task group metrics.

There were no major or repeated issues detected in the last three months. Richard, Glenn and Ian Simpson will continue to review the task group metrics monthly and request explanations for any red metrics. Metrics and summaries are located in eAuditNet under the Metrics application and in the NMC Work Area.

5.0 REVIEW SUBSCRIBER ACCREDITATION METRICS

The attached Subscriber Accreditation Committee (SAC) Metrics were reviewed. The SAC metrics were all green.

6.0 REVIEW NMC/BOARD OF DIRECTOR’S (BOD) METRICS

The attached BoD Metrics were reviewed.

7.0 POTENTIAL EQUITABLE PARTICIPATION METRIC UPDATE [MCA-104]

The Equitable Participation pilot metrics were reviewed.

This consists of 3 elements: Auditor interviews not cancelled due to lack of Subscriber Voting member attendance; Participation on Observation audits; Subscriber participation on Task Group and NMC approval ballots.

Richard Blyth presented data on Auditor interviews that were cancelled. This consisted of the number of cancellations per commodity over the last 12 months, and also the Subscribers who have participated. It was noted that there are a number of Subscribers who have not participated


UNCONFIRMED

on any interviews and Richard asked NMC Members to request support of the Commodity Task Group representatives on these interviews. The new process of scheduling interviews as reported by Bob Lizewski in item 2 is expected to increase participation and move this metric out of red. Bob Koukol suggested that the metric be changed from ‘Auditor Interviews not cancelled≥ 98%’ to ‘Auditor interview performed as planned ≥ 98%’. This was agreed by the Committee.

Richard Blyth presented data on Observation audits. This consisted of the number of Observation audits performed by each Subscriber. It was noted that one new Subscriber had performed an Observation audit since the February 2019 meeting. Actions to address this metric were discussed further in item 8.0

Jon Steffey presented data on ballot participation. As previously agreed the metric proposal is to establish which Subscribers vote on at least 80% of ballots in the prior 12 months. This metric only verifies this requirement when a Subscriber is mandating or accepting a given commodity. The proposal gave a combined Task Group / NMC participation percentage. This was reviewed and agreed by the Metrics Committee.

8.0 PROPOSAL TO IMPROVE OBSERVATION AUDIT EQUITABLE PARTICIPATION UPDATE [MCA-104]

At the February 2019 meeting, Lindsey Shaw agreed to lead a sub-team to develop a proposal to improve equitable contribution of Observation Audits. Lindsey noted that Subscribers that mandate the Nadcap process have been actively observing audits, while there is a lack of participation from companies that do not mandate.Lindsey presented the sub-team’s proposal. This includes a three-step escalation process, which would ultimately result in the removal of access to some data in eAuditNet for those Subscribers not performing at least 1 Observation Audit. If agreed, more specific language is needed for the expectations on observing audits and recourse for not meeting expectations. Improvement in communication with the Staff Engineers could also help when establishing the need to observe risk auditors.

Some Subscribers who have fixed costs, noted that they simply cannot support performing Observation audits. Scott Klavon suggested that it may be possible to adjust the payment schedule to include the cost for performing one observation audit, akin to how the current travel option is arranged. This would need to be explored further but may be an option to allow increased participation.

It was also noted that some audits have long durations and, in these cases, does the Observer need to be in attendance for the full duration.? Bob Lizewski confirmed that it is not necessary to observe the entire audit, but it is preferential to be present for either the opening / closing meeting and for the element(s) required for observation as noted by the Task Group in the Auditor risk analysis.

It was suggested that NMC members be retrained on how to search for auditors who need to be observed. Bob Lizewski agreed that he would be able to provide this at an NMC Steering meeting.


UNCONFIRMED

ACTION ITEM: Bob Lizewski to provide training to NMC Subscriber members on how to identify gaps in Task Group observation plans and identify auditors who require observation. (Due Date: 23-Oct-2019)

The sub-team agreed to review their proposal further, especially the proposed letter that would be sent to NMC representatives. Per direction from the Metrics Committee this should include all items with respect to equitable contribution, and at this time should refrain from identifying punitive actions that will result if equitable contribution is not achieved. This has been added to the existing RAIL item MCA-103. The proposed letter is to be sent to NMC members in advance of the October meeting.

ACTION ITEM: Lindsey Shaw to forward the sub-team’s proposed letter to encourage equitable contribution on observation audits to NMC members prior to the October 2019 meeting. (Due Date: 30-Sep-2019)

9.0 POTENTIAL QUALITY METRIC UPDATE

Richard Blyth presented the Quality Metric that is being piloted through 2019. Due to time constraints at the February 2019 meeting, a Webex meeting was arranged to discuss this metric further. At this meeting it was agreed to ask all Task Groups to investigate the causes for non-sustained corrective actions, determine any trends and implement best practices to reduce the number of non-sustaining NCRs.Additionally, the 5 Task Groups with the highest number of non-sustaining NCRs, Materials Testing, Heat Treat, Chemical Processing, NDT and Measurement & Inspection have been asked to provide feedback to the Metrics Committee by 15-Aug-2019.

Once received, Richard Blyth will convene a meeting to analyze the information received from these Task Groups.

ACTION ITEM: Ian Simpson to provide information from the 5 Task Groups with the highest number of non-sustained corrective actions to the NMC Metrics Committee and convene a meeting at the direction of the Chair to discuss their feedback. (Due Date: 31-Aug-2019)

10.0 NADCAP EFFECTIVENESS & CUSTOMER SATISFACTION 2017 SURVEY UPDATE

Ian Simpson presented the attached 2019 Nadcap Effectiveness and Customer Satisfaction Survey results.

Rusty Freelen will lead a team of John Pfeiffer, Ana Ottani Dos Santos, Pascal Blondet, Daniel Calderwood and Victor Schonberger to review data, agree on spider graph rating for the satisfaction of each stakeholder group, and determine actions to achieve level 4 or above for each category


UNCONFIRMED

ACTION ITEM: Rusty Freelen will lead a team of John Pfeiffer, Ana Ottani Dos Santos, Pascal Blondet, Daniel Calderwood and Victor Schonberger to review data, agree on spider graph rating for the satisfaction of each stakeholder group, and determine actions to achieve level 4 or above for each category. (Due Date: 23-Oct-2019)

11.0 NADCAP SUBSCRIBER MANDATES [NMC-72.2]

The NMC Metrics Committee was assigned an action at the February 2019 Steering meeting to discuss how Subscriber mandates are flowed down and implemented. The Supplier Support Committee (SSC) had received feedback that Subscribers are not always consistent in their approach and asked the NMC to review.

Richard Blyth presented the background and Jonathan Hebben noted that the SSC wanted to know if this was actually a problem.

Subscribers stated that this is a business decision and is not something that can be controlled by Nadcap. Data exists in eAuditNet that shows accredited companies against the entire list of companies provided by Subscribers, however use of this could be misleading if the data provided is not accurate. Jon Steffey agreed to provide training to NMC Subscriber members in a Steering meeting on how to update their Supplier approved list.

ACTION ITEM: Jon Steffey to provide training to NMC Subscriber members in a Steering meeting on how to update their Supplier approved list. (Due Date: 23-Oct-2019)

On the basis that this is not an issue that Nadcap can affect, the NMC Metrics Committee do not intend to pursue any further at this time.

12.0 NADCAP UPDATE

Due to lack of time, Scott Klavon’s Nadcap Update was not presented. Scott noted that this would be presented at the NMC-at-large meeting and there were no significant issues to report.

13.0 NEW BUSINESS REVIEW

Bob Lizewski asked for a discussion on the metrics defined in OP 1117 (Auditor Consistency). Due to lack of time this was not discussed and will be added to the October 2019 agenda.

14.0 NEW ACTION ITEMS

New action items were reviewed and will be added to the RAIL.


UNCONFIRMED

15.0 ADJOURNMENT

Meeting was adjourned at 1.20 pm

Minutes Prepared by: Jennifer Kornrumpf [email protected] / Ian Simpson [email protected]

***** For PRI Staff use only: ******

Are procedural/form changes required based on changes/actions approved during this meeting? (select one)

YES* ☐ NO ☒

*If yes, the following information is required: Documents requiring revision: Who is responsible: Due date:

mailto:[email protected]

mailto:[email protected]