uca-itca-entsoe-61968 iop report documents... · • the uca iop test report will be generated by...

Margaret GoodrichCIMug MeetingNov. 16, 2011

UCA Test CommitteeUCA ICTA Status

ENTSO-E IOP&

Part 3, Part 6, Part 9, Part 4,and Part 13 IOP Report

Topics• UCA Testing Committee/ICTA Status

• ENSTO-E IOP Results

• Infrastructure for 2011 61968 IOP Tests

• CIM 61968-Part 3 IOP

– IOP Participants

– IOP Test Witnesses

– IOP Result Highlights

• CIM 61968-Part 6 IOP




Topics

• Test Approach – 61968-Part 3 & Part 6– Part 3 Scenarios

– Part 6 Scenarios

• CIM 61968-Part 9 IOP– IOP Participants


– IOP Contents

– Test Scenarios

Topics• CIM61968-Part 4 and Part 13 IOP


– IOP Test Witnesses & Test Host

– IOP Contents


• Test Approach – 61968-Part 4 & Part 13– Profile Data Groups

– Import/Export Exchange Tests

– Interoperation Tests

– Power Flow Tests

• IOP Report Contents & Status

55

UCA Testing Committee Background• Until this year, the Committee only covered 61850

• Group created during UCA IUG creation for

• Began work in 2005 for

• Technical Tasks

– Test Procedures

– Quality Assurance Program

– Tester Accreditation

• Administrative Tasks

– Maintain Conformance Certificates

– Maintain testing documents

66

Testing Subcommittee Charter

• Composed of Chairs of each UG TestingSubcommittee

• Single point focus for UCA IUG

• Arbitrates technical issues

• Coordinates Test Subcommittee groups within UCA

– 61850 Testing

– Open Smart Grid Conformity

– CIM Conformance and Interoperability

77

UCA Pilot of NIST IPRM• UCA has volunteered to pilot IPRM

– UCA procedures almost meet IPRM

– UCA status will be improved

• Some changes needed: UCA and testers

– UCA to become Guide 65 Certification Body

• UCA must adopt formal quality management sys

• UCA will issue (sign off on) certificates

– Testers to become 17025 certified/compliant

• Tester will not have final say on certificate issue

• UCA will review the “tester file” before cert issued

February 1, 2010February 1, 2010 UCA IUG Testing Past, Present, and FutureUCA IUG Testing Past, Present, and Future 88

UCA Pilot of NIST IPRM (cont.)

• 2011 is transition year for IPRM

– User Group need to declare ITCA intent

– Lack of progress nullifies that declaration

• Changes needed

– Create quality manual for UCA testing

– Have testers upgrade 9001 -> 17025

– Remove tester authority to issue certificates

– Significant per-test UCA work (review all tests)

– Testing fees might be considered

ENTSO-E IOP 2011 – A brief overview of the test topics

• Interoperability using the last UML (v15 + Dynamics + any modificationsagreed among test participants) – new draft of the 2nd edition of theprofile

• Interoperability using 1st and 2nd editions of the profile, including namingconvention

• Model Authority Sets (MAS), file headers, model assembling process• Incremental exchange• Exchange of short-circuit data according to IEC 60909• Exchange of dynamic models (standard models, user-defined models,

proprietary models)• Diagram layout – 61970-453; GIS data• Exchange “operations to planning” – The goal: detailed model to be

exported to fit to ENTSO-E profile and imported by planning applications.• ENTSO-E Equipment profile is the 452, “operational to operational”

exchange

ENTSO-E IOP 2011 – A brief summary

• A lot of participants – more than 50 including vendors + testwitnesses

• Issues identified and submitted to IEC. Three major efforts started:– Profiles discussion – TF in WG13– CIM for Dynamics – 2nd phase of EPRI project ongoing– HVDC modelling – WG13 discusses this with a priority

• Complete interoperability between all tools could not be seen dueto the large scope of the test and the large number of tools thathave different level of development and different features that theysupport.

• Preparation of good test files is a challenge• Recommendation on the implementation of the draft 2nd profile –

currently under ENTSO-E discussion

Part 3, 6 & 9 Test Infrastructure

• All tests were remotely executed• The ESB vendors performed any transformation that was

necessary to transmit the messages from one Vendor toanother– From Generic WSDL to Strongly Typed WSDL– From Strongly Types WSDL to Java Messaging Services

• Connectivity tests between the ESB and the Product vendorswere conducted prior to the test as well as dry runs

• Used GoTo Meeting to allow the test witnesses to view thevendor screens, see the messages and watch the progress ofthe test.

Part 3 IOP Participants

• L+G AMI

• Oracle OMS

• Oracle ESB

• TIBCO ESB

• IBM ESB

• Alstom Grid DMS & SCADA

• EDF ESB

• EDF R&D SCADA

• GE OMS

• Telvent OMS

Part 3 IOP Test Witnesses

• David Bogen, ONCOR Electric Delivery (Transmission/DistributionOperator, USA)

• Frank Wilhoit, American Electric Power (AEP – Transmission/DistributionOperator, USA

• Jim Greene, American Electric Power (AEP – Transmission/DistributionOperator, USA

• Mark Ortiz, Consumers Energy (Transmission/Distribution Operator, USA)

• Hugo Bruers, Alcatel-Lucent (Belgium)

• Matthias Stifter, Austrian Institute of Technology (Austria)

Part 3 IOP Result Highlights• All planned scenarios were executed

• All Product and ESB Vendors Passed all executedscenarios

Part 3 Test Approach: Scenarios


• Alstom Grid DMS

• EDF R&D Simulator

• Sunflower Systems AMS

• IBM Maximo

• EDF ESB

• TIBCO ESB

• IBM ESB

• Oracle ESB


• David Bogen, ONCOR Electric Delivery (Transmission/DistributionOperator, USA)

• Frank Wilhoit, American Electric Power (AEP – Transmission/DistributionOperator, USA

• Jim Greene, American Electric Power (AEP – Transmission/DistributionOperator, USA

• Mark Ortiz, Consumers Energy (Transmission/Distribution Operator, USA)



Part 6 IOP Result Highlights• All planned scenarios were executed

• All Product and ESB Vendors Passed all executedscenarios

Part 6 Test Approach: Scenarios


• Oracle

• Elster

• Landis + Gyr

• OPC Foundation

• Ecologic

• EnergyICT

• eMeter

• AEP

• Alstom

• TIBCO ESB

• IBM ESB

• Oracle ESB


• David Bogen, ONCOR Electric Delivery

• Jerry Grey and John Simmins, EPRI

Part 9 IOP Contents

• Messages Tested Include:

– Meter Reading

– End Device Control

– End Device Event

Part 9 Test Scenarios

Meter Readings Sync R/R (1/2)

<MDM>eMeter

<AMI>AEP

<ESB>WebSphere ESB

MDM sends an on-demand meter readings

request to AMI

Get(GetMeterReadings) Get(GetMeterReadings)

ESB sends the meter readings request to AMIwithout Changes.

<MDM>eMeter

<AMI>AEP

<ESB>WebSphere ESB

Get(GetMeterReadings)

ESB sends the ACK to MDM

without changes

AMI returns an ACK toMDM synchronously

Request

Sync ACK Response

Get(GetMeterReadings)

Part 9 Test Scenarios

Part 4 & Part 13 IOP Participants

• Alstom Grid

• EDF

• GE Energy

• Open DSS

• Open Grid Systems

• Oracle

• Siemens

• SISCO

• SupeLec

• TIBCO

Part 4 & Part 13 IOP Test Witnesses & TestHost

• Alfredo Espinosa Reza, IIE (Institute for CFE, Mexico)

• Romano Napolitano, ENEL (DSO, Italy)



• EDF R&D – Michel Barberis, Eric Lambert, Pascale Bredillet forHosting the IOP and providing wonderful refreshments andfood!

Part 4 & Part 13 IOP Contents• CIM XML Profile Exchange tests for the Individual Profiles

with a Profile Group including:– Full Model Exchange (import and export)– Power Flow Solutions– Interoperation of full test models between two or more

vendors• CIM XML Profile Exchange tests for the combined Profile

Group including:– Full Model Exchange (import and export)– Power Flow Solutions– Interoperation of full test models between two or more

vendors

Part 4 and Part 13 IOP Result Highlights

• All vendors imported at least one Profile Group file for one ormore of the official test files.

• Five of the vendors ran a Power Flow solution on theimported files

• Seven of the vendors exported at least one set of ProfileData Group files for one or more of the official test files.

• All vendors executed one or more of the Interoperation TestProcedures

• There were also several unstructured tests generated andexecuted during this IOP.

Part 4 & Part 13 IOP Test Approach – ProfileData Groups

• For Power Flow:– Functional– Electrical Properties

• For GIS Import:– Functional– Asset

• For Power Flow Solution Exchange:– State Variables– Topology

Part 4 & Part 13 IOP Test Approach –Import/Export Exchange Tests

P artic ip an tA

X M LIm por t/Ex po rt

Te st Ca s e

5 .xBro w ser

XM LT oo lsX SL

S tyleShee t

C IMXM L

S c he m aX M L

Im p ort /Exp ort

P artic ip antB

Part 4 & Part 13 UCTE IOP Test Approach –Interoperation Tests

ParticipantA

ParticipantB

CIM XMLImport

TestCase-1

ModelMaint

System

CIM XMLImport

ModelMaint

System

CIM XMLExport

TestCase-2

CIM XMLValidator

Step 1

Steps 1,4Step 2

Step 2

Step 3

Step 4

Step 5

Steps1,4 Step 5

Part 4 & Part 13 IOP Test Approach – PowerFlow Tests

ParticipantA

ParticipantB

CIM XMLImport

TestCase-1

Power FlowApplication A

CIM XMLImport

Power FlowApplication B

Test Case-2(a previously imported/exported set ofCIM XML model files used in step 1)

CIM XMLValidator

Solution 1

(1)

(4,5)

(3)(2)

(2)

(1)

(3)

(4)

Solution 2

(2,5)

All IOP Reports: Contents & Status

• All IOP Test Reports will contain:– List of Vendors, Test Witnesses, Products and Models that were part of the

test including a full list of the Official files as well as the files that weregenerated

– Detailed Test Results– Product Descriptions for all participants– List of all Issues that were identified and the disposition/resolution/proposed

solution if possible– Summary description of the Test Approach

• The UCA IOP Test Report will be generated by the UCA and reviewed bythe team.

• The Report will be published to all UCA members, all SGIP/SGTCCmembers and every major CIM mail exploder we have as well as to manyCustomer lists by the Vendors.

• This report will be posted on the UCA Web Sites (both CIM and 61850) assoon as it is published.

Additional Information• UCA IOP Test Sponsors:

– Kay Clinard at UCA - [email protected]– Randy Lowe at AEP – [email protected]– John Simmins at EPRI – [email protected]

• UCA IOP Test Director:– Margaret Goodrich email – [email protected]– Margaret Goodrich Cell – + 1-903-477-7176

• UCA IOP Vendor Coordinators– 61968-4 – Bruce Scovill – [email protected]– 61968-13 – Eric Lambert – [email protected]– 61968-6 – Nada Reinprecht – [email protected]– 61968-3 – Jon Fairchild – [email protected]– 61968-9 – Margaret Goodrich – [email protected]

• IOP Host for 61850, 61968 Part 3, 4, 6, and 13:– Provided hosting, sponsorship and technical consulting– Eric Lambert – [email protected]

mailto:[email protected]










uca-itca-entsoe-61968 iop report documents... · • the uca iop test report will be generated by...

Documents