Brent Read Compliance Engineer - Enforcement

NERC PER Standards January 29 2013

Compliance User Group

2

Personnel Training and Qualifications

3

ldquoSystem Operators are single handedly the most important people in the electric industryrdquo

-Thomas Edison maybe ldquoThe trouble with quotes on the internet is that

you can never know if they are genuinerdquo -Abraham Lincoln

4

bull BS in Mechanical Engineering Technology o Texas AampM University College Station TX

bull 7 Years at a TOTOP in TX Interconnection o 4 yrs in engineering group o 3 yrs supervisingmanaging the control room

bull Joined WECC Enforcement in June 2012 bull NERC Certified Transmission Operator

Background

5

Importance of the PER Standards

6

bull System Operators are the most important parts of the BES

bull System Operators are responsible for ensuring a stable and reliable BES

bull System Operators must be able to take proper actions in normal and emergency system conditions

bull System Operators must be able to respond quickly and appropriately

Importance of the PER Standards

7

bull Review PER Standards bull Discuss Best Practices and Resources for

working with PER standards bull Discuss the Enforcement Review Approach

to the PER Standards

Agenda

8

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

9

bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Standard Review PER-001-02

10

bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel

Standard Review PER-002-0

11

bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary

responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System

o R22 Positions directly responsible for complying with NERC standards

Standard Review PER-002-0

12

bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria

Standard Review PER-002-0

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

2

Personnel Training and Qualifications

3

ldquoSystem Operators are single handedly the most important people in the electric industryrdquo

-Thomas Edison maybe ldquoThe trouble with quotes on the internet is that

you can never know if they are genuinerdquo -Abraham Lincoln

4

bull BS in Mechanical Engineering Technology o Texas AampM University College Station TX

bull 7 Years at a TOTOP in TX Interconnection o 4 yrs in engineering group o 3 yrs supervisingmanaging the control room

bull Joined WECC Enforcement in June 2012 bull NERC Certified Transmission Operator

Background

5

Importance of the PER Standards

6

bull System Operators are the most important parts of the BES

bull System Operators are responsible for ensuring a stable and reliable BES

bull System Operators must be able to take proper actions in normal and emergency system conditions

bull System Operators must be able to respond quickly and appropriately

Importance of the PER Standards

7

bull Review PER Standards bull Discuss Best Practices and Resources for

working with PER standards bull Discuss the Enforcement Review Approach

to the PER Standards

Agenda

8

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

9

bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Standard Review PER-001-02

10

bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel

Standard Review PER-002-0

11

bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary

responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System

o R22 Positions directly responsible for complying with NERC standards

Standard Review PER-002-0

12

bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria

Standard Review PER-002-0

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

3

ldquoSystem Operators are single handedly the most important people in the electric industryrdquo

-Thomas Edison maybe ldquoThe trouble with quotes on the internet is that

you can never know if they are genuinerdquo -Abraham Lincoln

4

bull BS in Mechanical Engineering Technology o Texas AampM University College Station TX

bull 7 Years at a TOTOP in TX Interconnection o 4 yrs in engineering group o 3 yrs supervisingmanaging the control room

bull Joined WECC Enforcement in June 2012 bull NERC Certified Transmission Operator

Background

5

Importance of the PER Standards

6

bull System Operators are the most important parts of the BES

bull System Operators are responsible for ensuring a stable and reliable BES

bull System Operators must be able to take proper actions in normal and emergency system conditions

bull System Operators must be able to respond quickly and appropriately

Importance of the PER Standards

7

bull Review PER Standards bull Discuss Best Practices and Resources for

working with PER standards bull Discuss the Enforcement Review Approach

to the PER Standards

Agenda

8

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

9

bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Standard Review PER-001-02

10

bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel

Standard Review PER-002-0

11

bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary

responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System

o R22 Positions directly responsible for complying with NERC standards

Standard Review PER-002-0

12

bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria

Standard Review PER-002-0

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

4

bull BS in Mechanical Engineering Technology o Texas AampM University College Station TX

bull 7 Years at a TOTOP in TX Interconnection o 4 yrs in engineering group o 3 yrs supervisingmanaging the control room

bull Joined WECC Enforcement in June 2012 bull NERC Certified Transmission Operator

Background

5

Importance of the PER Standards

6

bull System Operators are the most important parts of the BES

bull System Operators are responsible for ensuring a stable and reliable BES

bull System Operators must be able to take proper actions in normal and emergency system conditions

bull System Operators must be able to respond quickly and appropriately

Importance of the PER Standards

7

bull Review PER Standards bull Discuss Best Practices and Resources for

working with PER standards bull Discuss the Enforcement Review Approach

to the PER Standards

Agenda

8

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

9

bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Standard Review PER-001-02

10

bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel

Standard Review PER-002-0

11

bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary

responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System

o R22 Positions directly responsible for complying with NERC standards

Standard Review PER-002-0

12

bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria

Standard Review PER-002-0

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

5

Importance of the PER Standards

6

bull System Operators are the most important parts of the BES

bull System Operators are responsible for ensuring a stable and reliable BES

bull System Operators must be able to take proper actions in normal and emergency system conditions

bull System Operators must be able to respond quickly and appropriately

Importance of the PER Standards

7

bull Review PER Standards bull Discuss Best Practices and Resources for

working with PER standards bull Discuss the Enforcement Review Approach

to the PER Standards

Agenda

8

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

9

bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Standard Review PER-001-02

10

bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel

Standard Review PER-002-0

11

bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary

responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System

o R22 Positions directly responsible for complying with NERC standards

Standard Review PER-002-0

12

bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria

Standard Review PER-002-0

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

6

bull System Operators are the most important parts of the BES

bull System Operators are responsible for ensuring a stable and reliable BES

bull System Operators must be able to take proper actions in normal and emergency system conditions

bull System Operators must be able to respond quickly and appropriately

Importance of the PER Standards

7

bull Review PER Standards bull Discuss Best Practices and Resources for

working with PER standards bull Discuss the Enforcement Review Approach

to the PER Standards

Agenda

8

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

9

bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Standard Review PER-001-02

10

bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel

Standard Review PER-002-0

11

bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary

responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System

o R22 Positions directly responsible for complying with NERC standards

Standard Review PER-002-0

12

bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria

Standard Review PER-002-0

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

7

bull Review PER Standards bull Discuss Best Practices and Resources for

working with PER standards bull Discuss the Enforcement Review Approach

to the PER Standards

Agenda

8

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

9

bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Standard Review PER-001-02

10

bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel

Standard Review PER-002-0

11

bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary

responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System

o R22 Positions directly responsible for complying with NERC standards

Standard Review PER-002-0

12

bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria

Standard Review PER-002-0

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

8

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

9

bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Standard Review PER-001-02

10

bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel

Standard Review PER-002-0

11

bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary

responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System

o R22 Positions directly responsible for complying with NERC standards

Standard Review PER-002-0

12

bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria

Standard Review PER-002-0

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

9

bull R1 Each TOP and BA shall provide operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Standard Review PER-001-02

10

bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel

Standard Review PER-002-0

11

bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary

responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System

o R22 Positions directly responsible for complying with NERC standards

Standard Review PER-002-0

12

bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria

Standard Review PER-002-0

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

10

bull R1 Each TOP and BA shall be staffed with adequately trained operating personnel

Standard Review PER-002-0

11

bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary

responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System

o R22 Positions directly responsible for complying with NERC standards

Standard Review PER-002-0

12

bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria

Standard Review PER-002-0

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

11

bull R2 Each TOP and BA shall have a training program for all operating personnel that are in o R21 Positions that have the primary

responsibility either directly or through communications with others for the real-time operation of the interconnected Bulk Electric System

o R22 Positions directly responsible for complying with NERC standards

Standard Review PER-002-0

12

bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria

Standard Review PER-002-0

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

12

bull R3 For personnel identified in Requirement R2 the TOP and BA shall provide a training program meeting the following criteria

Standard Review PER-002-0

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

13

o R31 A set of training program objectives must be defined based on NERC and RRO standards entity operating procedures and applicable regulatory requirements These objectives shall reference the knowledge and competencies needed to apply those standards procedures and requirements to normal emergency and restoration conditions for the TOP and BA operating positions

Standard Review PER-002-0

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

14

o R32 The training program must include a plan for the initial and continuing training of TOP and BA operating personnel That plan shall address knowledge and competencies required for reliable system operations

o R33 The training program must include training time for all TOP and BA operating personnel to ensure their operating proficiency

Standard Review PER-002-0

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

15

o R34 Training staff must be identified and the staff must be competent in both knowledge of system operations and instructional capabilities

Standard Review PER-002-0

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

16

bull R4 For personnel identified in Requirement R2 each TOP and BA shall provide its operating personnel at least five days per year of training and drills using realistic simulations of system emergencies in addition to other training required to maintain qualified operating personnel

Standard Review PER-002-0

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

17

bull R1 Each RC shall staff its Real-time operating positions performing RC reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining a valid NERC Reliability Operator certificate

Standard Review PER-003-1

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

18

o R11 Areas of competency R111 Resource and demand balancing R112 Transmission operations R113 Emergency preparedness and operations R114 System operations R115 Protection and control R116 Voltage and reactive R117 Interchange scheduling and coordination R118 Interconnection reliability operations and

coordination

Standard Review PER-003-1

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

19

bull R2 Each TOP shall staff its Real-time operating positions performing TOP reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

20

o R21 Areas of competency R211 Transmission operations R212 Emergency preparedness and operations R213 System operations R214 Protection and control R215 Voltage and reactive

o R22 Certificates Reliability Operator Balancing Interchange and Transmission Operator Transmission Operator

Standard Review PER-003-1

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

21

bull R3 Each BA shall staff its Real-time operating positions performing BA reliability-related tasks with System Operators who have demonstrated minimum competency in the areas listed by obtaining and maintaining one of the following valid NERC certificates

Standard Review PER-003-1

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

22

o R31 Areas of competency R311 Resources and demand balancing R312 Emergency preparedness and operations R313 System operations R314 Interchange scheduling and coordination

o R32 Certificates Reliability Operator Balancing Interchange and Transmission Operator Balancing and Interchange Operator

Standard Review PER-003-1

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

23

bull PER-003-1 Footnote o Non-NERC certified personnel performing any

reliability-related task of a real-time operating position must be under the direct supervision of a NERC Certified System Operator stationed at that operating position the NERC Certified System Operator at that operating position has ultimate responsibility for the performance of the reliabilityndashrelated tasks

Standard Review PER-003-1

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

24

bull R1 Each RC BA and TOP shall use a systematic approach to training to establish a training program for the BES company-specific reliability-related tasks performed by its System Operators and shall implement the program

Standard Review PER-005-1

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

25

o R11 Each RC BA and TOP shall create a list of BES company-specific reliability-related tasks performed by its System Operators R111 Each RC BA and TOP shall update its list of

BES company-specific reliability-related tasks performed by its System Operators each calendar year to identify new or modified tasks for inclusion in training

Standard Review PER-005-1

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

26

o R12 Each RC BA and TOP shall design and develop learning objectives and training materials based on the task list created in R11

o R13 Each RC BA and TOP shall deliver the training established in R12

o R14 Each RC BA and TOP shall conduct an annual evaluation of the training program established in R1 to identify any needed changes to the training program and shall implement the changes identified

Standard Review PER-005-1

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

27

bull R2 Each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform each assigned task identified in R11 at least one time o R21 Within six months of a modification of the

BES company-specific reliability-related tasks each RC BA and TOP shall verify each of its System Operatorrsquos capabilities to perform the new or modified tasks

Standard Review PER-005-1

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

28

bull R3 At least every 12 months each RC BA and TOP shall provide each of its System Operators with at least 32 hours of emergency operations training applicable to its organization that reflects emergency operations topics which includes system restoration using drills exercises or other training required to maintain qualified personnel

Standard Review PER-005-1

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

29

o R31 Each RC BA and TOP that has operational authority or control over Facilities with established IROLs or has established operating guides or protection system to mitigate IROL violations shall provide each System Operator with emergency operations training using simulation technology such as a simulator virtual technology or other technology that replicates the operational behavior of the BES during normal and emergency conditions

Standard Review PER-005-1

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

30

bull PER-001-02 o Operating Personnel Responsibility and

Authority bull PER-002-0 o Operating Personnel Training

bull PER-003-1 o Operating Personnel Credentials

bull PER-005-1 o System Personnel Training

Standards Review

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

31

Best Practices

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

32

bull What are the challenges o Compliance with standards o Content o Creating ldquocleanrdquo and functional documentation o Availability of resources including operating

personnel o Training programs can be overwhelming

Best Practices for Training Programs

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

33

bull Reliability Standard Measures are often overlooked

bull When reviewing the standards continue beyond the Requirements to the Measures o Part of the individual standards Follows the

Requirements in the standard o Gives additional information to assist in

complying with the Requirements o Too often the Measures get overlooked

Best Practices Reliability Standard Measures

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

34

bull M1 Each RC TOP and BA shall have the following evidence to show that it staffed its Real-time operating positions performing reliability-related tasks with System Operators who have demonstrated the applicable minimum competency by obtaining and maintaining the appropriate valid NERC certificate (R1 R2 R3) o M11 A List of Real-time operating positions o M12 A list of System Operators assigned to its Real-time operating

positions o M13 A copy of each of its System Operatorrsquos NERC certificate or NERC

certificate number with expiration date which demonstrates compliance with the applicable Areas of Competency

o M14 Work schedules work logs or other equivalent evidence showing which System Operators were assigned to work in Real-time operating positions

PER-003-1 Measures

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

35

bull Some standards require training and can strengthen the training program

bull Use the non-PER standards as part of the training program o Use the standards to provide content o Use the standards to improve the quality of the

content o Use the standards to track the level of detail in

the training program

Best Practices Cross Reference Standards

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

36

bull Example of using the standards to improve content Black Start Restoration In an emergency restoration situation the

priority is integrity of the Interconnection not consumer load (EOP-005-1 R3)

Best Practices Cross Reference Standards

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

37

bull Example of using the standards to provide content

PRC-001-11 R1 Each Transmission Operator Balancing

Authority and Generator Operator shall be familiar with the purpose and limitations of Protection System schemes applied in its area

Best Practices Cross Reference Standards

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

38

bull For more related standards that may provide content review the following o EOP-005-1 R6 o EOP-005-2 R10 o EOP-008-0 R16

Best Practices Cross Reference Standards

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

39

bull Stack the evidence bull Keep your documentation clean and intact o Keep training documentation together in one

place o Duplication causes confusion

bull Specify the method of delivery of training

Best Practices Documentation

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

40

bull Plan your training schedule ahead of time o Create a timeline for delivering training o Prevents rushing to complete training at the

end of the year o Identifies available resources

bull Define Annual in your training program o If not defined we will default to Calendar year

Best Practices Documentation

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

41

bull Tell a good story o Use narratives to help explain the training

program training and learning objectives processes and procedures

bull Use diagrams charts andor pictures where appropriate o Illustrate your points o Provide additional clarity

Best Practices Documentation

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

42

bull Use other entities as a resource o Communicate with each other o Share training programs and resources o Share processes and methodologies o Assist each other in preparation for audits o Donrsquot be afraid to reach out to each other o Be willing to help each other

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

43

bull NERC Generic Task List o wwwnerccomdocsstandardssarGeneric_Sy

stem_Operator_Task_Listxls

bull DOE Systematic Approach to Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1078pdf

Best Practices Use Available Resources

44

bull DOE Guide to Good Practices for Continuing Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk111899pdf

bull DOE Guide to Good Practices ndash Evaluation Instrument Examples o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1201pdf

Best Practices Use Available Resources

45

bull DOE Guide to Good Practices for On-the-Job Training o httpwwwhssdoegovnuclearsafetytechstds

docshandbookhdbk1206pdf

Best Practices Use Available Resources

46

bull NERC Reliability Standards o httpwwwnerccompagephpcid=2|20

bull RSAWs o httpwwwweccbizcomplianceUnited_States

DocumentsComplete20set20of20RSAWszip

Best Practices Use Available Resources

47

bull The Measures section of each standard provides clear guidance

bull Cross reference all applicable standards bull Invest time in your documentation The devil

is in the details bull Use existing resources

Review of Best Practices

48

Enforcement Review Approach

49

bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards

bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES

Enforcement Review Approach

50

bull Does your training program provide Initial and continuing training for operating personnel

bull Does your training program have clear training and learning objectives

bull For individual standard requirement Audit Approaches use the RSAWs

Enforcement Review Approach

51

bull PER-001-02 R1 o Evidence that the entity provides (and has

provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Enforcement Review Approach RSAW Example

52

Enforcement Review Approach RSAW Example

53

Too much

54

bull Reviewed the PER Standards bull Discussed Best Practices and Resources

available bull Discussed the Enforcement Review

Approach used when reviewing training programs and documentation

A Look Backhellip

55

bull Is this your reaction when we call you or you have to call us

WECC Staff

56

bull Our goal is the same as yours we want to improve the reliability of the BES

bull Take the time to review your training program on a regular basis

bull Utilize all of the available resources you can find

bull Remember the devil is in the details

Wersquore Here to Help

Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz

Questions

• Brent ReadCompliance Engineer - Enforcement
• Personnel Training and Qualifications
• Slide Number 3
• Background
• Importance of the PER Standards
• Importance of the PER Standards
• Agenda
• Standards Review
• Standard Review PER-001-02
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standards Review
• Best Practices
• Best Practices for Training Programs
• Best Practices Reliability Standard Measures
• PER-003-1 Measures
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Review of Best Practices
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach RSAW Example
• Enforcement Review Approach RSAW Example
• Too much
• A Look Backhellip
• WECC Staff
• Wersquore Here to Help
• Slide Number 57

48

Enforcement Review Approach

49

bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards

bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES

Enforcement Review Approach

50

bull Does your training program provide Initial and continuing training for operating personnel

bull Does your training program have clear training and learning objectives

bull For individual standard requirement Audit Approaches use the RSAWs

Enforcement Review Approach

51

bull PER-001-02 R1 o Evidence that the entity provides (and has

provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Enforcement Review Approach RSAW Example

52

Enforcement Review Approach RSAW Example

53

Too much

54

bull Reviewed the PER Standards bull Discussed Best Practices and Resources

available bull Discussed the Enforcement Review

Approach used when reviewing training programs and documentation

A Look Backhellip

55

bull Is this your reaction when we call you or you have to call us

WECC Staff

56

bull Our goal is the same as yours we want to improve the reliability of the BES

bull Take the time to review your training program on a regular basis

bull Utilize all of the available resources you can find

bull Remember the devil is in the details

Wersquore Here to Help

Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz

Questions

• Brent ReadCompliance Engineer - Enforcement
• Personnel Training and Qualifications
• Slide Number 3
• Background
• Importance of the PER Standards
• Importance of the PER Standards
• Agenda
• Standards Review
• Standard Review PER-001-02
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standards Review
• Best Practices
• Best Practices for Training Programs
• Best Practices Reliability Standard Measures
• PER-003-1 Measures
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Review of Best Practices
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach RSAW Example
• Enforcement Review Approach RSAW Example
• Too much
• A Look Backhellip
• WECC Staff
• Wersquore Here to Help
• Slide Number 57

49

bull Does your training program ensure that operating personnel are familiar with all of the applicable NERC standards

bull Does your training program ensure operating personnel are trained to properly respond to any situation within their area of responsibility within the BES

Enforcement Review Approach

50

bull Does your training program provide Initial and continuing training for operating personnel

bull Does your training program have clear training and learning objectives

bull For individual standard requirement Audit Approaches use the RSAWs

Enforcement Review Approach

51

bull PER-001-02 R1 o Evidence that the entity provides (and has

provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Enforcement Review Approach RSAW Example

52

Enforcement Review Approach RSAW Example

53

Too much

54

bull Reviewed the PER Standards bull Discussed Best Practices and Resources

available bull Discussed the Enforcement Review

Approach used when reviewing training programs and documentation

A Look Backhellip

55

bull Is this your reaction when we call you or you have to call us

WECC Staff

56

bull Our goal is the same as yours we want to improve the reliability of the BES

bull Take the time to review your training program on a regular basis

bull Utilize all of the available resources you can find

bull Remember the devil is in the details

Wersquore Here to Help

Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz

Questions

• Brent ReadCompliance Engineer - Enforcement
• Personnel Training and Qualifications
• Slide Number 3
• Background
• Importance of the PER Standards
• Importance of the PER Standards
• Agenda
• Standards Review
• Standard Review PER-001-02
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standards Review
• Best Practices
• Best Practices for Training Programs
• Best Practices Reliability Standard Measures
• PER-003-1 Measures
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Review of Best Practices
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach RSAW Example
• Enforcement Review Approach RSAW Example
• Too much
• A Look Backhellip
• WECC Staff
• Wersquore Here to Help
• Slide Number 57

50

bull Does your training program provide Initial and continuing training for operating personnel

bull Does your training program have clear training and learning objectives

bull For individual standard requirement Audit Approaches use the RSAWs

Enforcement Review Approach

51

bull PER-001-02 R1 o Evidence that the entity provides (and has

provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Enforcement Review Approach RSAW Example

52

Enforcement Review Approach RSAW Example

53

Too much

54

bull Reviewed the PER Standards bull Discussed Best Practices and Resources

available bull Discussed the Enforcement Review

Approach used when reviewing training programs and documentation

A Look Backhellip

55

bull Is this your reaction when we call you or you have to call us

WECC Staff

56

bull Our goal is the same as yours we want to improve the reliability of the BES

bull Take the time to review your training program on a regular basis

bull Utilize all of the available resources you can find

bull Remember the devil is in the details

Wersquore Here to Help

Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz

Questions

• Brent ReadCompliance Engineer - Enforcement
• Personnel Training and Qualifications
• Slide Number 3
• Background
• Importance of the PER Standards
• Importance of the PER Standards
• Agenda
• Standards Review
• Standard Review PER-001-02
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standards Review
• Best Practices
• Best Practices for Training Programs
• Best Practices Reliability Standard Measures
• PER-003-1 Measures
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Review of Best Practices
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach RSAW Example
• Enforcement Review Approach RSAW Example
• Too much
• A Look Backhellip
• WECC Staff
• Wersquore Here to Help
• Slide Number 57

51

bull PER-001-02 R1 o Evidence that the entity provides (and has

provided) operating personnel with the responsibility and authority to implement real-time actions to ensure the stable and reliable operation of the Bulk Electric System

Enforcement Review Approach RSAW Example

52

Enforcement Review Approach RSAW Example

53

Too much

54

bull Reviewed the PER Standards bull Discussed Best Practices and Resources

available bull Discussed the Enforcement Review

Approach used when reviewing training programs and documentation

A Look Backhellip

55

bull Is this your reaction when we call you or you have to call us

WECC Staff

56

bull Our goal is the same as yours we want to improve the reliability of the BES

bull Take the time to review your training program on a regular basis

bull Utilize all of the available resources you can find

bull Remember the devil is in the details

Wersquore Here to Help

Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz

Questions

• Brent ReadCompliance Engineer - Enforcement
• Personnel Training and Qualifications
• Slide Number 3
• Background
• Importance of the PER Standards
• Importance of the PER Standards
• Agenda
• Standards Review
• Standard Review PER-001-02
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standards Review
• Best Practices
• Best Practices for Training Programs
• Best Practices Reliability Standard Measures
• PER-003-1 Measures
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Review of Best Practices
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach RSAW Example
• Enforcement Review Approach RSAW Example
• Too much
• A Look Backhellip
• WECC Staff
• Wersquore Here to Help
• Slide Number 57

52

Enforcement Review Approach RSAW Example

53

Too much

54

bull Reviewed the PER Standards bull Discussed Best Practices and Resources

available bull Discussed the Enforcement Review

Approach used when reviewing training programs and documentation

A Look Backhellip

55

bull Is this your reaction when we call you or you have to call us

WECC Staff

56

bull Our goal is the same as yours we want to improve the reliability of the BES

bull Take the time to review your training program on a regular basis

bull Utilize all of the available resources you can find

bull Remember the devil is in the details

Wersquore Here to Help

Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz

Questions

• Brent ReadCompliance Engineer - Enforcement
• Personnel Training and Qualifications
• Slide Number 3
• Background
• Importance of the PER Standards
• Importance of the PER Standards
• Agenda
• Standards Review
• Standard Review PER-001-02
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standards Review
• Best Practices
• Best Practices for Training Programs
• Best Practices Reliability Standard Measures
• PER-003-1 Measures
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Review of Best Practices
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach RSAW Example
• Enforcement Review Approach RSAW Example
• Too much
• A Look Backhellip
• WECC Staff
• Wersquore Here to Help
• Slide Number 57

53

Too much

54

bull Reviewed the PER Standards bull Discussed Best Practices and Resources

available bull Discussed the Enforcement Review

Approach used when reviewing training programs and documentation

A Look Backhellip

55

bull Is this your reaction when we call you or you have to call us

WECC Staff

56

bull Our goal is the same as yours we want to improve the reliability of the BES

bull Take the time to review your training program on a regular basis

bull Utilize all of the available resources you can find

bull Remember the devil is in the details

Wersquore Here to Help

Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz

Questions

• Brent ReadCompliance Engineer - Enforcement
• Personnel Training and Qualifications
• Slide Number 3
• Background
• Importance of the PER Standards
• Importance of the PER Standards
• Agenda
• Standards Review
• Standard Review PER-001-02
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standards Review
• Best Practices
• Best Practices for Training Programs
• Best Practices Reliability Standard Measures
• PER-003-1 Measures
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Review of Best Practices
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach RSAW Example
• Enforcement Review Approach RSAW Example
• Too much
• A Look Backhellip
• WECC Staff
• Wersquore Here to Help
• Slide Number 57

54

bull Reviewed the PER Standards bull Discussed Best Practices and Resources

available bull Discussed the Enforcement Review

Approach used when reviewing training programs and documentation

A Look Backhellip

55

bull Is this your reaction when we call you or you have to call us

WECC Staff

56

bull Our goal is the same as yours we want to improve the reliability of the BES

bull Take the time to review your training program on a regular basis

bull Utilize all of the available resources you can find

bull Remember the devil is in the details

Wersquore Here to Help

Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz

Questions

• Brent ReadCompliance Engineer - Enforcement
• Personnel Training and Qualifications
• Slide Number 3
• Background
• Importance of the PER Standards
• Importance of the PER Standards
• Agenda
• Standards Review
• Standard Review PER-001-02
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standards Review
• Best Practices
• Best Practices for Training Programs
• Best Practices Reliability Standard Measures
• PER-003-1 Measures
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Review of Best Practices
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach RSAW Example
• Enforcement Review Approach RSAW Example
• Too much
• A Look Backhellip
• WECC Staff
• Wersquore Here to Help
• Slide Number 57

55

bull Is this your reaction when we call you or you have to call us

WECC Staff

56

bull Our goal is the same as yours we want to improve the reliability of the BES

bull Take the time to review your training program on a regular basis

bull Utilize all of the available resources you can find

bull Remember the devil is in the details

Wersquore Here to Help

Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz

Questions

• Brent ReadCompliance Engineer - Enforcement
• Personnel Training and Qualifications
• Slide Number 3
• Background
• Importance of the PER Standards
• Importance of the PER Standards
• Agenda
• Standards Review
• Standard Review PER-001-02
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standards Review
• Best Practices
• Best Practices for Training Programs
• Best Practices Reliability Standard Measures
• PER-003-1 Measures
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Review of Best Practices
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach RSAW Example
• Enforcement Review Approach RSAW Example
• Too much
• A Look Backhellip
• WECC Staff
• Wersquore Here to Help
• Slide Number 57

56

bull Our goal is the same as yours we want to improve the reliability of the BES

bull Take the time to review your training program on a regular basis

bull Utilize all of the available resources you can find

bull Remember the devil is in the details

Wersquore Here to Help

Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz

Questions

• Brent ReadCompliance Engineer - Enforcement
• Personnel Training and Qualifications
• Slide Number 3
• Background
• Importance of the PER Standards
• Importance of the PER Standards
• Agenda
• Standards Review
• Standard Review PER-001-02
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standards Review
• Best Practices
• Best Practices for Training Programs
• Best Practices Reliability Standard Measures
• PER-003-1 Measures
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Review of Best Practices
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach RSAW Example
• Enforcement Review Approach RSAW Example
• Too much
• A Look Backhellip
• WECC Staff
• Wersquore Here to Help
• Slide Number 57

Brent Read Compliance Engineer ndash Enforcement (801) 819-7689 breadweccbiz

Questions

• Brent ReadCompliance Engineer - Enforcement
• Personnel Training and Qualifications
• Slide Number 3
• Background
• Importance of the PER Standards
• Importance of the PER Standards
• Agenda
• Standards Review
• Standard Review PER-001-02
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-002-0
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-003-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standard Review PER-005-1
• Standards Review
• Best Practices
• Best Practices for Training Programs
• Best Practices Reliability Standard Measures
• PER-003-1 Measures
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Cross Reference Standards
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Documentation
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Best Practices Use Available Resources
• Review of Best Practices
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach
• Enforcement Review Approach RSAW Example
• Enforcement Review Approach RSAW Example
• Too much
• A Look Backhellip
• WECC Staff
• Wersquore Here to Help
• Slide Number 57