tricentis tosca riga - tapost · requirements risk coverage test scope test data optimize number of...

27
RIGA TRICENTIS TOSCA Deniss Afonicevs

Upload: others

Post on 05-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

RIGA

TRICENTISTOSCA

Deniss Afonicevs

Page 2: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

WHO AM I

• MORE THAN 16 YEARS IN DEVELOPMENT

• ~5 YEARS AT ACCENTURE

• DEVELOPMENT LEAD

• CI &TEST AUTOMATION ARCHITECT

• TEST AUTOMATION ARCHITECT

• TRICENTIS TOSCA EVANGELIST

Copyright © 2018 Accenture All rights reserved. 2

Page 3: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

WHY AUTOMATED TESTING IS SO IMPORTANT?

Copyright © 2018 Accenture All rights reserved. 3

Page 4: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

Jun 1996 - Ariane exploded after 40 sec

MOST EXPENSIVE BUGS

Copyright © 2018 Accenture All rights reserved. 4

$500 Millions

Aug 2003 Race Condition Bug Creates Blackout 50 Million People

Sep 1999 Mars Climate Orbiter explosion due unit measure BUG $ 327 Million

Page 5: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

Copyright © 2018 GeekWire, LLC 5

April 2015

Affected : 7,000 stores in the US and 1,000 in Canada

At the end of the day approximate looses was :

$3 or $4 million

FREE COFFEE! STARBUCKS

https://www.geekwire.com/2015/coffee-crisis-starbucks-computers-go-down-nationwide-free-drinks-for-everyone/

Page 6: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

Copyright © 2018 CNBC LLC. All Rights Reserved. A Division of NBCUniversal 6

Jan 2017

Affected : US

Cause:

thousands of customers

UNITED AIRLINES DOMESTIC FLIGHTS GROUNDED FOR 2 HOURS BY COMPUTER GLITCH

https://www.cnbc.com/2017/01/22/all-united-airlines-domestic-flights-grounded-by-computer-outage.html

July, the same airline’s flights were disrupted

after a computer problem blocked access to

reservations records.

Page 7: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

Copyright © 2018 Accenture All rights reserved. 7

April 2017

Truing to migrate millions of cutomers

Affect :

1.9 million people to lose access

12.5 K Customers gone

TCB SOFTWARE MIGRATION FAIL

Source : https://www.theguardian.com/business/2018/apr/23/tsb-online-banking-failure-prompts-

complaints`

Migrating to a new core banking system is a

horrendous task and there are so many thousands of

things that have to happen exactly as expected, or

disaster can unfold.”(https://www.computerweekly.com/news/252439859/TSB-IT-meltdown-has-the-makings-of-an-epic)

Page 8: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

• LIMITED TIME &RESOURCES• BIG OR UNCLEAR SCOPE• CROSS PLATFORM• TEST DATA• DISTRIBUTED SERVICES

MAIN ISSUES FACED

Copyright © 2018 Accenture All rights reserved. 8

Page 9: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

TRICENTIS TOSCA

TOSCA IS MORE THAN JUST A

TESTING TOOL…

9Copyright © 2018 Accenture All rights reserved.

Page 10: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

TRICENTIS IS CONTINUOUS TESTING COMPANY

10

Worldwide Operations

Austria (HQ) USA (HQ)

400+

Germany SwitzerlandThe NetherlandsAustralia PolandIndia UK

Strong GSI Partnership

Founded 2007

Page 11: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

11

500+ Blue Chip Enterprise Customers

Banking Insurance Financial Services

Travel & Hospitality Energy

Healthcare/Medical

Telco

Manufacturing

Retail & Other

Page 12: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

Continuous Testing Platform

Test

Automation

Risk-based

TestingLoad Testing

Service

Virtualization

Test Data

Management

Exploratory

Testing

End-to-End Functional & Load Testing

Optimize & Manage AutomateExplore

Integration / DevOps Toolchain

XCode

Page 13: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

PLAN CODE & TEST DESIGN BUILDCONTINUOUS

TESTINGDEPLOY MONITOR

Page 14: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

HP UFT

Selenium… Exploratory Testing

Model-Based

Test Automation

30+ Technologies

Packaged Apps

MobileCross

Browser

SAPBI &

Big Data

Risk-based

Testing

Test Data

Management API

Tosca

Connect

Analytics

Dashboards

IntegrationsDEX Server

DevTest: Daily executions or

check-in based, covers unit tests, ST and SIT

Service

Virtualization

Release Test: Executed with a

reduced velocity,covers E2E Tests.

ToscaCI

Tosca

Connect

Test

Management

Plan Code & Test Design Version Build Automated Test Deploy MonitorProvision

Risk

Analysis

Load Test

Requirements

PLAN CODE & TEST DESIGN BUILDCONTINUOUS

TESTINGDEPLOY MONITOR

Page 15: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,
Page 16: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

Requirements Risk coverage Test scope

Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests, UI-Tests, Mobile

etc

Over 35 SupportedTechnologies

Lego Blocks that helpsteer our TestCases

Page 17: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

KEY FEATURES

• Module based testing

• Test Data Design

• Test data management

• Risk based test coverage

• The Exploratory Testing

• E2E testing cross different technologies

• No programming or scripting skill needed

• Full test life cycle in one tool

• Converting manual tests to automated

• Collaboration

• Parallel test case execution

Page 18: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

Flexibility in changes

1

Composite design …

2

Scanning real applications

3

> 30 technology specific adapters …

4

MODULARITY

Page 19: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

TECHNOLOGIES

Page 20: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

• SOAP, REST, CUSTOM

• IMPORT DEFINITIONS• WSDL

• WADL

• XSD

• Swagger

• Odata

• Json schema

• QUICK TEST FUNCTION

API

20

Page 21: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

SERVICE TESTING

Copyright © 2018 Accenture All rights reserved. 22

Page 22: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

ORCHESTRATED SERVICE VIRTUALIZATION

Copyright © 2018 Accenture All rights reserved. 23

OSV

Page 23: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

LIVE DEMO

Copyright © 2018 Accenture All rights reserved. 24

Page 24: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

• TIME REDUCTION ON COMPLEX TEST CASES• TEST SCENARIO MAINTENANCE• FLEXIBILITY ON REQUIREMENTS CHANGES• SAP TESTING • MICRO SERVICE TESTING• CROSS TECHNOLOGY TESTING• TEST DATA MANAGEMENT

MAIN BENEFITS

Page 25: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

Real World ExampleAustralian Bank

Test Cases Risk Coverage Run Time

600 85% 5 WEEKS2 WEEKSINCL. TDM

model-based test

Automation

Automate

value-based

Test Cases

Optimize

Start 2200 30% 8 WEEKS

Continuous

Integration

Integrate

< 3 HOURS

Continuous regression

automation level

87%

smoke testing

1 HOURS

regression testing

2 DAYS

26

smoke testing

12 MINS

Page 26: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

Compared to traditional manual testing, Automation provides a 500%

efficiency in test execution.

Duration

Manual 2 weeks

Executing 102 test cases and 337 business components

(3 weeks)

3 daysAutomated

3 peopleManual

Automate

d

2 people

We are able to run the scripts in 6 hours but we consider a 3 days

window due to the time to bug fix and retest

Page 27: TRICENTIS TOSCA RIGA - TAPOST · Requirements Risk coverage Test scope Test Data Optimize Number of TestCases for Maximum Effectiveness Reusable for TestData Management (TDM), API-Tests,

QUIZ…

Copyright © 2018 Accenture All rights reserved.

[email protected]

https://lv.linkedin.com/in/deniss-afonicevs