testing challenges in the iot - cloud object storagedemand...fast time to market for integration of...

14
28-04-2016 Testing challenges in IoT

Upload: others

Post on 25-May-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

28-04-2016

Testing challenges in IoT

Page 2: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice

Atos – Global Testing Services

Ralf MACK Senior Test Consultant

Ovidiu URSACHI Senior Test Consultant

2

Page 3: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice

Overview

3

IoT versus traditional IT

IoT cases

Integration and Interoperability

Maintainability

Usability

Security

Page 4: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice

IoT vs „traditional“ IT

4

Page 5: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice

IoT case: R-Link for Renault Connected Vehicle

Solution

▶ Create an open and flexible back-end platform including AppStore, M2M, in-car & web payment

▶ Integrate B2C services & many service/Content providers

▶ Interface with RSA IT for end-to-end process handing and existing telematics system

▶ Develop In-car Apps and context-aware services

Benefits

▶ Multiple-sales channel handling maximizing revenues

▶ Deployment underway in 40 countries, 50 planned

▶ Fast Time to Market for integration of third-parties

▶ Future-proof solution (multi-device, multi-connectivity)

▶ Context-aware innovative services (Low Fuel)

Business challenges

▶ Connecting cars to cloud services for mid/high range cars

▶ Supply Infotainment & Connected Navigation apps

▶ Integrate a complex eco-system of business partners around a new business model and in-dash Tablet

5

Page 6: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice

IoT case: Bosch Siemens Home Appliances – Home Connect

Business challenges

▶ Consolidate his premium positioning

▶ Increase his knowledge and loyalty on their clients

▶ Develop a « Service oriented » business model

▶ Propose a service with a complete data privacy

▶ Improvement maintenance and appliances efficiency

Solution

▶ A worldwide platform handling various brand & products

▶ Offering secured data flows between the consumers (smartphones, tablets, laptop) and their appliances

▶ Via ADSL box of the customer

▶ Integrated with CRM & e-commerce solutions

▶ Coupled with a contextualization data engine to seize « big data » opportunities

Benefits

▶ Service Launched at IFA 2014 (Start of Sales Dec. 2014)

▶ Expected volumes: 230 millions always on appliances in 2030

6 6

Page 7: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice

Interoperability and Integration

7

Device

• Different suppliers

Communi-cation

• Physical layer

• Network layer

• Transport layer

Gateway

Backend

Analytics

• Business Intelligence

• Automate Operation

Endpoint

• Apps

• Mobile devices

• M2M

Integration on different levels

▶ Gaps in functional specifications and standards

▶ Complex End-to-End chain with many variables

Increased need for Interoperability and Integration testing

Page 8: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice

Maintainability – test IoT persistency Focus on Consumer Goods

8

Consumer good category

Speciality Shopping Convenience

e.g. luxury brands very expensive, brand loyality

e.g. TV, cameras fairly expensive,

infrequent purchase

less expensive,

frequent purchase

Maintenance category

Corrective

Perfective

Adaptive

Preventive / Predictive

Patching, Security

Enhancements over multitude of devices

Adoptions to changed environments

Reduction of future maintenance

SW change (DIY*)

HW change (DIY*)

Service technician

Automated or on request SW update by customer

Exchange of HW modules by customer

Exchange of HW by technician

Change type

*DIY – Do it yourself

Page 9: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice

IoT Maintainability for durable consumer goods

Devices connected to IoT

• long live span of cars, dishwashers, fridges …

• regular new product releases and firmware / HW variants

Security issues

• found several times per year

• some fixes may need HW updates

Mobile Apps

• new versions released several times per year

9

uncountable number of

device variants How to ensure security across

device live span?

How to secure App interoperation with multiplicity

of existing devices?

Now … 20 years later

Page 10: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice

IoT facets of design under test

10

UI / visual design

Platform design

Interusability Conceptual

model

Interaction design

Industrial design

Service design

Productisation

Most visible Least visible

Figure adapted from the book „Designed connected products“ by Rowland, C. et. al

Page 11: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice

Privacy and security problems

11

Privacy problems

• data brokers

• de-anonymisation

• breaches

• eavesdropping

Security problems

• spoofing

• buffer overflow

• threats through APIs

• firewall bypass

• outdated software (maintainability)

• enrollment of devices

• DDoS amplifier

Tests

• check against best practices - policies

• check cryptography

• check resilience against unexpected

events and malicious spoofed packets

• work in fail-safe mode

• update flow and procedures

Page 12: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice

Security – New challenges to be considered

12

Security

Concept

Penetration

Test Thingbots

Drones

Cross-device attacks

Cloud

Voice and video control

Backdoors

Server heartbleed

Page 13: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

| 28-04-2016 | Ovidiu Ursachi, Ralf Mack | © For public use Global Testing Practice

Key messages

13

Integration and Interoperability

increasing tester Skills, exploding complexity, complex test infrastructure

Maintainability

long-term maintainability, device explosion, integrated E2E test automation

Usability

different over platforms, different contexts, distributed, industrial design influences

Security

Privacy issues, spoofing, thingbots, firewall bypassing, maintenance, cross-device attacks

Page 14: Testing challenges in the IoT - Cloud Object StorageDemand...Fast Time to Market for integration of third-parties Future-proof solution (multi-device, multi-connectivity) Context-aware

Atos, the Atos logo, Atos Consulting, Atos Worldgrid, Worldline, BlueKiwi, Canopy the Open Cloud Company, Yunano, Zero Email, Zero Email Certified and The Zero Email Company are registered trademarks of Atos. February 2016. © 2016 Atos. Confidential information owned by Atos, to be used by the recipient only. This document, or any part of it, may not be reproduced, copied, circulated and/or distributed nor quoted without prior written approval from Atos.

Thanks

For more information please contact:

Ovidiu Ursachi, MBA, PMP Ralf Mack T: +49 211 399 48444 T: +49 211 39938855 M: +49 163 1661957 M: +49 177 2153647 [email protected] [email protected]