testing constrained combinations vera pironska qa engineer xaml team 1 xaml team 1 telerik qa...
TRANSCRIPT
![Page 1: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/1.jpg)
Classification Trees Testing
Testing Constrained Combinations
Vera PironskaQA Engineer XAML Team 1
Telerik QA Academy
![Page 2: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/2.jpg)
Table of Contents What is Classification Trees Testing Constructing Classification Trees and Test Cases
Tool Support CTE XL - Graphical Editor For
Classification Trees Some Useful Tips
2
![Page 3: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/3.jpg)
What Is Classification Trees Testing
Main Concepts
![Page 4: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/4.jpg)
Constrained Options In some cases separate factors in a system are constrained Certain options for one factor won't
coexist with certain options for another factor
4
![Page 5: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/5.jpg)
Classification Tree Method
Classification Tree Method: A black-box test design technique Test cases are designed to execute
combinations of representatives of input and/or output domains
Test cases are described by means of a classification tree
Based on the functional specification of the test object
5
![Page 6: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/6.jpg)
What Is a Classification Tree?
Classification tree:
6
A tree showing equivalence partitions hierarchically ordered.
Used to design test cases in the classification tree method.
![Page 7: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/7.jpg)
When Do We Use Classification Trees?
Classification trees are used as a way to test constrained combinations of factors
They also allow us to test some factors more heavily than others
7
![Page 8: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/8.jpg)
Advantages of Classification Trees
Help for easy generating and maintaining test cases
Classification trees can provide precise information about coverage
They help to reduce documentation
8
![Page 9: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/9.jpg)
Benefits & Rewards From Using CT
Maintenance of test cases Easier & more cost effective
Visibility of testing scope For new projects Regression testing
User buy-in Great visual for gaining acceptance
Exports to other testing techniques and tools
9
![Page 10: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/10.jpg)
Constructing Classification
Trees and
Test CasesMain Steps
of the Process
![Page 11: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/11.jpg)
A Classification Tree Example
This is a simple example of a classification tree for an Adaptive cruise control system
11
![Page 12: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/12.jpg)
Aspects of Interest Identifying aspects of interest
The first activity performed for each testing problem when applying the technique of classification trees testing
Represent a collection of things that are supposed to interact in some interesting way Things, which combinations the
tester wants to test
E.g., blocks12
![Page 13: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/13.jpg)
Identifying Classifications
Identifying classifications within the areas of interest The things that are supposed to
interact with each other In some cases subclassifications for
one or more classifications will be identified
E.g., size, color, form
13
![Page 14: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/14.jpg)
Identifying Classes Classes have to be identified for each classification Performed by using standard
equivalence partitioning and boundary value analysis
Classifications identification can be recursively applied to classes
14
![Page 15: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/15.jpg)
Aspects of Interest, Classifications, Classes -
Example
15
Aspect of interest
Classification
classes
Another classification level
Another class level
![Page 16: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/16.jpg)
Defining the Combination Rules
In order to derive test cases we need to define rules for combining the classifications in a tree Do we want pairs of all factors? Triples of some factors? Are there exclusions, i.e., classes
that can't combine? Etc.
16
![Page 17: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/17.jpg)
Generating Test Cases Once the combination rules are defined – test cases can be generated Test cases can be defined by
combining classes from different classifications
A "leaf" is selected for each base classification
Classes that belong to the same classification are non combinable By definition classes are disjunctive
17
![Page 18: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/18.jpg)
Separating Specification
From Data A Classification Tree specifies test cases, but it does not specify test data Implementation of a test case
specification into concrete test data is a separate procedure
18
![Page 19: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/19.jpg)
Creating a Classification Tree
for a GridView Selection
PropertiesDemo
![Page 20: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/20.jpg)
Tool Support
For Classification Trees Testing
![Page 21: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/21.jpg)
Tool Support Usually classification trees and test cases are generated using a special tool Supports drawing the classification
trees Allows automatic generation of test
cases
21
![Page 22: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/22.jpg)
CTE XLGraphical Editor For Classification
Trees
![Page 23: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/23.jpg)
CTE XL CTE XL is a graphical editor for classification trees Has a free and a paid version Source:
http://www.berner-mattner.com/en/berner-mattner-home/products/cte/index.html
23
![Page 24: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/24.jpg)
Features of CTE CTE XL supports the following features Drawing and editing classification
trees Adding description and
commentaries Adding, repositioning trees, storing
in libraries Automated test case generation User-defined dependency rules Integration of requirement and test
management tools
24
![Page 25: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/25.jpg)
Models Of Test Generation
Minimal combination Creates a test suite that uses every
class from each classification at least once in a test case
Pairwise combination Creates a test suite that uses every
class pair from disjunctive classifications at least once in a test case
25
![Page 26: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/26.jpg)
Models Of Test Generation (2)
Threewise combination (“triple-wise”) Creates a test suite that uses every
triple of classes from disjunctive classifications at least once in a test case
Complete combination Creates a test suite that uses every
possible combination of classes from disjunctive classification in a test case
26
![Page 27: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/27.jpg)
Test Coverage The objective of the Classification Tree Method is to determine a sufficient but minimum number of test case specifications Well designed specifications reduce
the number of tests
27
![Page 28: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/28.jpg)
Some Useful TipsGood Practices for Using CT
![Page 29: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/29.jpg)
Some Useful Tips If your trees become too large
Break it down with references to the higher level tree (folding)
Start off small (high level) Give yourself time to apply the technique
29
![Page 30: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/30.jpg)
Classification Trees Testing
Questions? ?
?? ? ?
???
?
?
![Page 31: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/31.jpg)
Exercises1.Create a classification tree for a
life insurance program that calculates insurance premiums based on the following factors:Have the client been smoking (yes / no)
Is the client disabled (yes / no)Have the client been diagnosed with life threatening disease (yes / no)
31Continues …
![Page 32: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/32.jpg)
Exercises (2)Have the client been hospitalized in the past (yes / no)
BMI (Body-Mass Index) (<17 / 18-33 / 34-36 / 37-39 / >39)
Age (18-39 / 40-59 / >59) Derive test cases by using every
class from each classification at least once in a test case
32
![Page 33: Testing Constrained Combinations Vera Pironska QA Engineer XAML Team 1 XAML Team 1 Telerik QA Academy Telerik QA Academy](https://reader035.vdocuments.us/reader035/viewer/2022062312/5518c3e9550346a61f8b56d7/html5/thumbnails/33.jpg)
Exercises (3)2. Derive test cases for all pairs from
the example bellow:
Suppose you need to test compatibility of various kiosk configurations based on three major factors, each set to one of the options shown:
Operating System: Windows XP or Linux
Browser: Internet Explorer (Windows only), Netscape, or Opera
Connection: DSL, dial-up, or cable
33