model-based black box testing in automotive and its standardization layers (extract)

25
Model-Based Black Box Testing in Automotive and its Standardization Layers (extract) THE SOLUTION TO BOOST YOUR TEST EFFICIENCY MaTeLo

Upload: tender

Post on 23-Feb-2016

57 views

Category:

Documents


0 download

DESCRIPTION

Model-Based Black Box Testing in Automotive and its Standardization Layers (extract). MaTeLo. THE SOLUTION TO BOOST YOUR TEST EFFICIENCY. AUTOMOTIVE USE CASE. “Test Object” Presentation. “Test Framework” Presentation. EXAM. LabVIEW GUI. Automation API. Control API. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

Model-Based Black Box Testingin Automotive

and its Standardization Layers(extract)

THE SOLUTION TO BOOST

YOUR TEST EFFICIENCY

MaTeLo

Page 2: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

AUTOMOTIVE USE CASE

Page 3: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

“Test Object” Presentation

Page 4: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

“Test Framework” Presentation

Inputs Outputs

Real -Time NovaSim Environment

Simulink Plant Model

Automation API Control API

LabVIEW GUIEXAM

Page 5: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

MODEL BASED TEST PROCESS

Page 6: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

TestEnvironment

MODEL-DRIVEN ENGINEERING

FunctionalRequirements

UsageModel

DesignModel

Test CasesCode

Test ScriptsEXE

DESIGN TEST

GenerateGenerate

DeriveCompile

Implement Scenarize

MaTeLoModel Based Testing

Page 7: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

MODEL BASED TEST PROCESS

BY PICTURES

Page 8: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

MaTeLo MODEL = TEST SPECIFICATION

Page 9: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

MaTeLo TEST CASE = TEST CASE SPEC

Input Expected Result

State

Requirement

Test Function Verdict

Page 10: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

EXAM TEST SEQUENCE = TEST CASE IMPLEMENTATION (Abstract)

BEGINNING

END

INTERFACE

Page 11: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

EXAM GENERATED CODE = TEST IMPLEMENTATION SCRIPT (Concret)

CLASS

Python Code

Page 12: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

ALL4TEC MaTeLo and

the “TEST MESS”

Page 13: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

THEORETICAL MBT WORKFLOW

AutomationTest Framework

Test Scheduler

Simulator

SystemUnderTest

Test Execution

Log

UsageModel

Test Cases

FunctionalRequirements

AtomicTest

Action

Test Cases

Verdicts

Confidence& Coverage

Reports

Test Scripts

Page 14: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

AutomationTest Framework

A 1ST INDUSTRIAL TOOLS INTEGRATION

UsageModel

Test Cases

Simulator

SystemUnderTest

Test Execution

Log

Test Cases

Verdicts

Confidence& Coverage

Reports

FunctionalRequirements

AtomicTest

Action

Test Scheduler

Test Scripts

EXAM

UML

Python

dSpace

MicroNova

Carts

Vision CAN

IOs

Doors

MaTeLo

Page 15: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

AutomationTest Framework

A 2nd INDUSTRIAL TOOLS INTEGRATION

UsageModel

Test Cases

Simulator

SystemUnderTest

Test Execution

Log

Test Cases

Verdicts

Confidence& Coverage

Reports

FunctionalRequirements

AtomicTest

Action

Test Scheduler

Test Scripts

dSpace

MicroNova

Carts

Vision CAN

IOs

Doors

TestStand

Proprietary

Opal-RT

NI

Clemessy

Diagnostic Calibration

Radio

Reqtify

MS Excel

MaTeLo

EXAM

UML

Python

Page 16: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

AutomationTest Framework

VARIOUS TOOLS INTEGRATION

UsageModel

Test Cases

Simulator

SystemUnderTest

Test Execution

Log

Test Cases

Verdicts

Confidence& Coverage

Reports

FunctionalRequirements

AtomicTest

Action

Test Scheduler

Test Scripts

TestStand

Proprietary

dSpace

Opal-RT MicroNova

NI

Clemessy Carts

Vision

Diagnostic Calibration

CAN

IOs

Radio

Doors Reqtify

MS Excel

EXAM

UML

Python

PROVEtech Proprietary

CANoe EXACT

TTCN-3

VB

C, C#CSV

Java

Simulink CANoe

Flexray

Temperature

XML

CSVHP QC

MaTeLo

Page 17: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

AutomationTest Framework

VARIOUS TOOLS INTEGRATION

UsageModel

Test Cases

Simulator

SystemUnderTest

Test Execution

Log

Test Cases

Verdicts

Confidence& Coverage

Reports

FunctionalRequirements

AtomicTest

Action

Test Scheduler

Test Scripts

TestStand

Proprietary

dSpace

Opal-RT MicroNova

NI

Clemessy Carts

Vision

Diagnostic Calibration

CAN

IOs

Radio

Doors Reqtify

MS Excel

EXAM

UML

Python

PROVEtech Proprietary

CANoe EXACT

TTCN-3

VB

C, C#CSV

Java

Simulink CANoe

Flexray

Temperature

XML

CSVHP QC

MaTeLo

Page 18: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

AutomationTest Framework

MBT AND ITS STANDARDS

UsageModel

Test Cases

Simulator

SystemUnderTest

Test Execution

Log

Test Cases

Verdicts

Confidence& Coverage

Reports

FunctionalRequirements

AtomicTest

Action

Test Scheduler

Test Scripts

TestStand

Proprietary

dSpace

Opal-RT MicroNova

NI

Clemessy Carts

Vision

Diagnostic Calibration

CAN

IOs

Radio

Doors Reqtify

MS Excel

EXAM

UML

Python

PROVEtech Proprietary

CANoe EXACT

TTCN-3

VB

C, C#CSV

Java

Simulink CANoe

Flexray

Temperature

XML

CSVHP QC

RIF

ATX

ATX ATX

ODS

OTX HIL API

ODX

FIBEX XCP

GDI

ATX

MaTeLo

Page 19: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

ALL4TEC VIEW WITH STANDARDS

Page 20: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

ABSTRACTION LAYERS

Usage Scenario Description

Test Flow ControlDevice Driver

Test Case Specification

System Under Test Hardware In the Loop Test Bench

PythonPrecompiled Application

UML Sequence Diagram

Markov-Chain Usage Model

<< derive >>

<< generate >>

<< control >>

MaTeLo

Third Party Equipment

ATX

HIL API

ODX, FIBEX, XCP…

Page 21: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

ABSTRACTION MANAGEMENT & STANDARDIZATION

HIL Plateform

dSpaceNovaSim

CartsASAM HIL API

…Proprietary

Network

CAN_1CAN_2LIN_X

FlexRay_1

…FlexRay_2

Functions

Manual GearAuto GearHand Free

ACC

…StartStop

Test Tools

CANoeCANape

INCAMS Excel

…Diag Tool

Env. Model

GasolineDieselTurboHybrid

…Electric

Available Test Configurations

Test Case 1 Test Case 2 Test Case n

Strategic Test Cases

Possible Usage Scenarios

ATX

HIL APIHIL API ODX, FIBEX, XCP…

Page 22: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

OTHER STANDARD CONSIDERATION (ATX)

Page 23: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

„Related Work“

© ASAM e. V. ATX – Introduction, History, and Goals

23

Page 24: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

CONNECTIONATX / (OTX, TTCN3, HIL API)

Page 25: Model-Based Black Box Testing in Automotive and its Standardization  Layers (extract)

ATX – OTX cooperation model

© ASAM e. V. ATX – Introduction, History, and Goals

25

ASAM ATX Part 1 (TDX+TAF Folder, Result, Suites - TAF Core)

OTX CoreISO WD/13209-2

OTX Standard Libraries(Lib-Com, Lib-Mmi, …)ISO WD/13209-3

ASAM ATX Part 2 Standard Libraries for ASAM HIL API