afnet & prostep ivip step ap242 benchmark #2...

DIESAR Direction Internationale de l’Evaluation, de la Sécurité et des Affaires Réglementaires

1

AFNeT Standardization Days 2017

AFNeT & ProSTEP iViP

STEP AP242 Benchmark #2 Presentation

By Kevin Le TutourBenchmark Project Manager, AFNeT

April 19 & 20, 2017 STEP AP242 Benchmark #2 - AFNeT Standardization Days 2017 - Paris


2


The last step before operational solutions for the industries

August 2014

2nd CAD Benchmark

1st PDM Benchmark



3


To provide a public status of STEP AP242 functionalities available for operational use

n ISO STEP AP242 Ed1 is available for the Automotive and Aerospace industries as well as many other branches of the manufacturing industry as a unique product data standard

n Complete & neutral quality control of AP242 based implementations on the market

n Functionalities & systems to be benchmarked are given by the user communitiesn Based on test criteria:

§ formal correctness of the file§ fulfilment of end-to-end validation properties§ end-user validation



4


Agenda

nBenchmark #2 CAD test casesnBenchmark #2 PDM test case

For both work packages:§Test models, test cases and test procedure§Functionalities scope §Tests Results Report



5


Benchmark #2 CAD test cases



6


Test cases and related test models TC# Test case name Criteria overview Example of test modelTC1 3D exact geometry • Solid, surface, curve conversion

• Geometry Presentation (color, …)• Geometric validation properties• Transparency, invisibility• User defined attributes

TC2 3D tessellated geometry • Solid, surface, curve conversion• Geometry Presentation (color, …)• Validation properties

TC3b PMI graphic tessellated (3D exact geometry) • PMI graphic presentation• Saved views• Cross highlight• PMI Validation properties

TC3c PMI semantic link with graphic (3D exact geometry)

• PMI semantic representation• Saved views• Cross highlight • PMI Validation properties

TC4 PMI graphic tessellated (3D tess geometry) • PMI graphic presentation• Saved views• Cross highlight • PMI Validation properties

TC6c CAD assembly BOM XML ext ref assembly STEP tessellated geometry compressed

• Assembly structure• Assembly Validation properties• External reference to geometry

TC6d CAD assembly AIM P21 Nested assembly STEP exact geometry

• Assembly structure• Assembly Validation properties• External reference to geometry



7


Testing procedure



8


Participating solutions and formats in scope

Vendors Solution name

Autodesk Inventor Professional 2017CoreTechnologie 3DEvolution 4.0

3DAnalyzer 4.0Dassault Systèmes CATIA V5R26

3DEXPERIENCE R2016xDatakit CrossManager 16.2Elysium ASFALIS X7.0Kisters 3DViewStation 2016.0TechSoft3D Tetra4D 2016.1

Native format in scope

CATIA V5

Creo

NX

Inventor

SolidWorks

3D PDF only from STEP to 3D PDF



9


Publication in May 2016

n Short report will be officially available:http://benchmark.ap242.org/

n Long version of Benchmark only for AFNeT Associations Members and participating vendors

http://www.afnet.fr/dotank/sps/ap242benchmar/



10


Benchmark #2 PDM test case

STEP AP242 Benchmark #2 - AFNeT Standardization Days 2017 - ParisApril 19 & 20, 2017

September 2016 to March 2017


11


Participating Vendors and Testing sites


Windchill 11.0 M020

COMPDM 2.0 OpenPDM 8

ASFALIS EX7.1.12 3DEXPERIENCE R2017x

CrossManager v17.1 3D_Evolution 4.1


12


Test modeln Nominal Test model: AP242 BO Model XML + AP242 P21 Geometryn Test model: AS1 (defined in ISO 10303-44)n Test model and test scope have been tested before in the PDM IF

See http://www.cax-if.de/library/



13


Tested functionalities in scopen Exchange of PDM Information using AP242 BO Model XML

n Transfer of PDM-relevant information § Part number, Version, Life cycle status, document management information, etc.

n Transfer of Assembly Validation Properties

n References to geometry (STEP Part 21 files / CAD models)

n References to non-CAD documents (PDF, JPG)

n Management of changes (new versions, updated life cycle status)



14


Verified properties and business rules in scopen Properties

§ Resolved product structure without configuration information§ Part properties (number, name, description etc.)§ 3D positioning matrix§ Instance name of part usage§ CAD or non-CAD Document properties

(number, name, version, creator etc.)§ External file properties

(name, creator and creation date, last modifier and Date)§ Life cycle status (released, in work, etc.)

n Business rules§ CAx-IF Recommended Practices for STEP AP242 BO Model XML Product and

Assembly Structure v1.1



15


Testing procedure

PDM Sys. B

BenchmarkTestEnv.

Export modifiedData

ExportData

STEP files check

Import DataEnd-user checks

Import DataManage ChangesEnd-user checks

3

4a

5

6

7

8

Re-Import sameSample DataEnd-user check

ImportSample Data

End-user check1 2

Sample STEP-XML

PDM Sys. A

Phas

e 1

Phas

e 2

Base

d on

Ste

p 1

Compare to Sample XML

STEP filescheck

Phas

e 3

Afte

r STE

P fil

e se

lect

ion

4b



16


Results Overview by tools (Short Version)



17


Results by PDM functionalities



18


Results by STEP conformity criteria



19


Summary

n Good level of STEP AP242 BO XML implementation for PDM product structure exchange

n Most of in-scope PDM functionalities robustly supported, except for the transfer of the benchmarked assembly validation properties

n Concerning conformity tests of produced STEP files, most results are positive

n As the Recommended Practices become more and more stable over time, it is expected that the results will also be improved in this area

n Next AFNeT & ProSTEP iViP benchmark with tests of extended functionalities to be planned in 2018



20


Publicationn Short report is officially available:

http://benchmark.ap242.org/

n Long version of Benchmark only for Associations Members and participating vendors:§ Detailed results of tested software§ Precise results tables of every

executed step§ Precise table of every criterion

n Websites§ http://www.afnet.fr/dotank/sps/ap242

benchmar/§ http://www.prostep.org/en/medialibra

ry/publications/benchmarks.html

Content

1 Introduction2 References and terms

2.1 Reference documents2.2 Terms

3 Test methodology3.1 Functionalities tested in this Benchmark3.2 Testing Strategy3.3 Synthetic Test Case Specifications: PDM Assembly with 3D Geometry3.4 List of tested applications3.5 STEP file selected as reference for phase

4 Test Results4.1 Overview of the Test Results4.2 Overall Test Results

5 Summary6 Publication of the Long Report of PDM test case7 Acknowledgements



21


Conclusionn Since PLM vendors and CAD integrators constantly enhance the functionalities

and robustness of their STEP AP242 interfaces, the results of this benchmark provide a snapshot of the functionalities tested at a certain moment in time for a specific version of the vendors solutions.

n New editions of this Benchmark report will be published, addressing additional software & functionalities.

n The use of international open standards for 3D Model Based interoperability is seen as a key enabler to support global engineering and manufacturing of complex products within the extended enterprise.

n It also contributes to ensure a better independence regarding PLM vendor’s proprietary formats, and long-term preservation of 3D Model Based design.

n The availability of COTS STEP AP242 solutions for PDM data interoperability contributes to answer to this challenge.



22


Related web sites, contacts and Acknowledgements

n AP242 project: http://www.ap242.org/

n AP242 Benchmark: http://benchmark.ap242.org/

n PDM-IF: http://www.pdm-if.org/

n CAx-IF: http://www.cax-if.org

n Private website: http://plmtf.sharepoint.com/benchmark

Related web sites Testing Team Contactsn AFNeT

Pierre Duchier, Frédéric Darré, Aminata Mbengue Kevin Le Tutour, Gaël Diquelou

AFNeT

30 rue de Miromesnil 75008 Paris

[email protected]

Tel.: +33 (0) 144 568 750

n ProSTEP iViP

Jochen Boy, Felix Klier

ProSTEP iViP

Dolivostraße 11 D-64293 Darmstadt

[email protected]

Tel.: +49 6151 9287 440


n Thanks to the applications Vendors who provided their COTS applications for the

Benchmark testing, for their support in the installation, and for the analysis of the test

results.

n Thanks the CAx-IF and the PDM-IF for the STEP Recommended Practices and the test

case.

n Thanks Airbus, Dassault Aviation, Daimler, Daher, MBDA, Liebherr, Zodiac Aerospace,

ASD-SSG, GALIA, GIFAS, PFA, VDA, AFNeT & ProSTEP iViP Members for their funding

and orientations.

Acknowledgements


23


AP242 on a page



24


New in AP242: Business Object Model XML

BM-Scope

MotivationAs designated backbone for data exchange in the manufacturing industry, the capability to exchange PDM data in XML format is a key factor.

Scopen General Administrative Datan Part and Document Managementn Propertiesn Assembly Structuren Requirementsn Configuration, Effectivityn Compositesn Kinematicsn External References



25


Phas

e 1

Sam

ple

STEP

impo

rt

Test scenario, procedure and methodology

PDM Sys. B

BenchmarkTestEnv.

Export modifiedData

ExportData

STEP files check


Import DataManage ChangesEnd-user checks

3

4a

5

6

7

8

Re-Import sameSample DataEnd-user check

ImportSample Data

End-user check1 2

Sample STEP

dataset

PDM Sys. A

Phas

e 2

STEP

exp

ort a

nd c

heck


STEP filescheck

Phas

e 3

Impo

rt fro

m s

elec

ted

STEP

file

s

4b n The test scenario:

§ New import

§ Re-import (allow to see how the tool behave: overwrite, duplicate, etc.)

§ Export data and export modified data

§ Import changes (modification of description attributes, geometry, part position, etc.),

§ Interpret revision numbers,

§ Import life cycle status.n STEP files checks

§ XML files will be checked for syntax and structures (XSD conformity)

§ compliance with business rules will be checked using Schematron

§ Check visually XML content + compare to initial file

n End-user checks

§ Check for completeness and

§ correctness of product structure and attributes

n STEP file selection

§ Select the best STEP file out of 4.

§ Select the best STEP file out of 7.



26


Procedure for 3DEvolution

AllPDM Sys.

BenchmarkTestEnv.

ExportData


2

4a

5

1

Sample STEP-XML


STEP filescheck

4b

3DEvolution

ImportSample Data

End-user checkPhas

e 1

Sam

ple

STEP

impo

rt

Phas

e 2

STEP

exp

ort a

nd c

heck

Phas

e 3

Impo

rt fro

m s

elec

ted

STEP

file

s



27


Procedure for CrossManager

BenchmarkTestEnv.


Import DataEnd-user checks5bis 8bis

Sample STEP-XML

CrossManager 3D PDF

3DGeometryreview

Phas

e 1

Sam

ple

STEP

impo

rt

Phas

e 2

STEP

exp

ort a

nd c

heck

Phas

e 3

Impo

rt fro

m s

elec

ted

STEP

file

s



28


Overview of the AS1 assembly structure, including indication of changes



29


List of tested applications


afnet & prostep ivip step ap242 benchmark #2...

Documents