applying keyword driven testing to validate vehicle … · software standardization (e.g. autosar)...

24
APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE SOFTWARE © All rights reserved Jorge Pascal (TKI Automotive GmbH) Technical Lead (HiL & Test Automation) Bettina Sieber (MicroNova AG) Project Lead Testautomation

Upload: others

Post on 23-Sep-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE SOFTWARE

© All rights reserved

Jorge Pascal (TKI Automotive GmbH)Technical Lead (HiL & Test Automation)

Bettina Sieber (MicroNova AG)Project Lead Testautomation

Page 2: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

© All rights reserved

1. PRESENTERS INTRODUCTION

2. AUTOMOTIVE INDUSTRY CHALLENGE

3. PROJECT GOAL AND OBJECTIVES

4. THERMAL MANAGEMENT TEST RIG: OVERVIEW

5. TEST REQUIREMENTS: VEHICLE DRIVING CYCLES

6. KEYWORD-DRIVEN TEST TOOL: TEST CASE GENERATOR

7. EXAMPLE: PULL-DOWN

8. CONCLUSIONS: ADDED VALUES

Page 3: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

AUTOMOTIVE INDUSTRY CHALLENGE

© All rights reserved

Page 4: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

The Changing Automotive Landscape

4

“In the next decade, the automotive industry will face a magnitude of change that has not been seen in a century. This change will be driven primarily by four mutually reinforcing trends, i.e., autonomous, connected, electric, and shared (ACES) vehicles…” Source: Automotive software and electronics 2030, McKinsey & Company

© All rights reserved

Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming a commodity i.e. Software is the most important added value to the final product

Surge in Complexity of Software Functions (i.e. Energy Domain)

Increasing Safety Criticality of Software Functions

Higher demand for faster and cost effective Verification & Validation Processes

Split of SW market into SW development, integration, and

Validation/VerificationBreakdown of SW development efforts into domains

Page 5: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

Source:

Volkswagen Group’s

MQB plug-in hybrid powertrain;

foundation for Golf GTE, A3 e-

tron, and more.

Green Car Congress, 2014

5 © All rights reserved

Thermal Management System Overview: Hybrid (PHEV), Electric (BEV) Vehicles

Source:

Klimatisierung und

Thermomanagement

IAV Automotive

EngineeringPower

Electronics

DCDC

ConverterBattery

Charger

Electric

Motor

Battery

HVACCompressor

Aux. Heater

Aux. Heater

Heating and Cooling Vehicle System

in Electric Vehicles

Cooling Circuits

Condenser

Fan

Page 6: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

AUTOMATED VIRTUAL DRIVING CYCLES:PROJECT GOAL AND OBJECTIVES

© All rights reserved

Page 7: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

Project Goal and Objectives

7 © All rights reserved

Shift In-Vehicle Tests to a Test Rig (reduction of the number of vehicle prototypes)

Raise Productivity in terms of Test Cases

Customer Focus on Specifying and not on Implementing Tests

Provide an efficient Software Validation Process based on Customer Skill Set (good Knowledge on In-Vehicle Software Validation)

Improve Communication within the Test Team

Drive cross functional cooperation within the Organization

Page 8: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

THERMAL MANAGEMENT TEST RIG: OVERVIEW

© All rights reserved

Page 9: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

9 © All rights reserved

Test Rig: System HiL

Calibration Interface

Actual Plant including all cooling circuit components,heat exchangers, HVAC, pipe, compressor,actuators / sensors Simulation Modules:

Front- & HVAC Air Modules

Co

ola

nt

Sim

N

T

Co

ola

nt

Sim

tNT

Co

ola

nt

Sim

VK

M

CAN: „HIL, Customer-PC, Operator-PC <-> Ipetronik Simulation Modules“

„Operator-PC“

MPI-Bus „Operator-PC (Ipemotion) <-> Test Rig-PLC“

Hybrid-CAN: „HIL -> Interface to Calibration Interface -> Automation-PC“

Wiring harness <-> Actuators / Sensors Test Bench

TM-ECU

KBTFront

Wir

ing

HIL

<->

EC

U

POD-Interface (XCP-on-Ethernet): „TME-ECU <-> VX1131“

„Automation-PC“

LWL „HIL <–>

Automation-PC (ControlDeskNG)“

USB (VAS5163): Automation-PC <-> Diagnostic Connector HIL

Page 10: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

TEST REQUIREMENTS: VEHICLE DRIVING CYCLES AND EXPECTED SYSTEM RESPONSE

© All rights reserved

Page 11: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

11 © All rights reserved

Test Specification

BranchPoint

BranchPoint

Junction

Junction

Cooler

Page 12: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

KEYWORD-DRIVEN TEST TOOL:TEST CASE GENERATOR

© All rights reserved

Page 13: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

Implemented

TestCase in

EXAM

Manual

implementation

in EXAM

TestCase

description text

in EXAM

Workflow without Test Case Generator

13

Test cases are implemented manually, according to Test Specifications

Problems:

• Data Maintenance necessary in Several Places

• Slow, error-prone manual Implementation

• High Variance in Implementation

© All rights reserved

Test specification,

e. g. in DOORS

Page 14: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

Automatic Generation of Test Cases

14 © All rights reserved

Test SpecificationPrecondition:

10. Ignition on

Action:

20. Stop Sending 'FRA::ESP_21'

30. Wait for DTC '40004' active 20s

Postcondition:

40. Ignition off

Expected Result:

30. Check DTC '40004' active

Operation Mapping

String from Testspec EXAM Operation

„Ignition on“

„Klemme 15 an“

„Stop Sending %1

„Wait for DTC %1 %2 %3“

Sequence Diagram

Generated, executable

TestCase

Page 15: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

USE CASE: PULL-DOWN

© All rights reserved

Page 16: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

Pull-Down: SPEC

16 © All rights reserved

Play Video

showing how to generate test cases out of DOORS Test Specifications

(under Construction)

Page 17: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

Pull-Down: DOORS Synchronizer

17 © All rights reserved

Page 18: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

Pull-Down: Test Case Description

18 © All rights reserved

Page 19: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

Pull-Down: Mapping

19 © All rights reserved

Page 20: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

Pull-Down: Test Case Generation

20 © All rights reserved

Page 21: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

Pull-Down: Test Case

21 © All rights reserved

Page 22: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

CONCLUSIONS: ADDED VALUES

© All rights reserved

Page 23: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

Key Take Aways

23 © All rights reserved

Increasing SW Complexity drives the adoption of new Test Methods such as Keyword Driven Testing

Provides an excellent Common Ground for cross functional Cooperation within the Organization

The Usage of Test Case Generation sets the first Milestone for a well defined and structured Software Validation Process

Automatic Test Case Generation raises Productivity and Quality Standards while reducing Time to Market

Page 24: APPLYING KEYWORD DRIVEN TESTING TO VALIDATE VEHICLE … · Software Standardization (e.g. Autosar) enables the separation from Hardware and Software. As result, Hardware is becoming

24 © All rights reserved

Thank you for your attention!

Q&A Time!

Time for Questions and hopefully also for some Answers…

Special Thanks to our Colleagues from Audi (EK-4, EE-I3) and dSPACE!!!