systematic test design a smarter strategy?5a+ bf6 af1 enter person with valid email address already...
TRANSCRIPT
-
Systematic Test Design
– A Smarter Strategy?
Richard Mash
Capgemini
-
Systematic Test Design –
A Smarter Strategy?
Richard Mash
Senior Test Manager
(UK Test Processes & Methods)
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Objectives
The objectives today are to:
Describe a systematic approach to test design
Identify the benefits that we gained
• Test case review effort and defects
To „plant some ideas‟ for ways that you could do similarly
Describe how tools can help
• (common tools and test tools)
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Content
Content
Context
Why we needed a systematic approach
The Design Process
• 3 Steps
• Process Automation
Lessons Learned
Benefits
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Context
Projects
Customer driven
• Changing Requirements
Bespoke
Large – 6-24 months & 5-10 testers
Fixed Price
• Time Limited
• Cost Limited
• Overrun ➙ profitability, pay, bonus!
Variable resources
Use Case based specifications
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Systematic Test Design
The Problem
Iteration Test
PlanUse Case
Specification
Test Case
DesignTest Case
DesignTest Case
DesignTest Design
Test Case
DesignTest Case
DesignTest Case
DesignQA Review
Complex UC = 10 Days Design (300 Test Cases)
Test Design Tools constraining us
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Systematic Test Design
Aims
• Reduce „misspent‟ effort
• Reduce QA effort
• Systematic Process
• Possibility for automatingTest Case
DesignTest Case
DesignTest Case
Design
Test Design
Iteration Test
PlanUse Case
Specification
?QA Review
Test Design
QA Review?
Test Case
DesignTest Case
DesignTest Case
Design
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Systematic Test Design
The Solution
Test Case
DesignTest Case
DesignHigh LevelTest Case
Design
Control Points QA Review
Target – Maximum Duration 1 Day
+ address need to break down Use Cases
Iteration Test
PlanUse Case
Specification
Test Case
DesignTest Case
DesignHigh LevelTest Case
Design
1.
OutlineTest
Design
Test Case
DesignTest Case
DesignHigh Level Test Case
Design
Test Case
DesignTest Case
DesignHigh LevelTest Case
Design
QA Review
Test Case
DesignDesign
High LevelTest Case
2.
DetailedTest
Cases
DetailedTest
Design
3.
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Control Points
Examine specification for ‘Control Points’
Inputs & Actions& Pre-Conditions
Test Steps
Outputs &Post-Conditions
Verifications
Conditions & Business Rules
Variations ofInputs / Outputs
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Control Points
Record Control Points
Numeric Reference
Link variants of same I/O
Cross References
Use Case Steps & Rules
Alphabetic Suffix
Distinguish variants ofsame condition
Conditions with Steps & Verifications
Splitting
e.g. 2a2b
e.g. BF2AF1.2
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
?
4. The Actor enters the information and selects the option to continue.
5. The System validates that all mandatory details have been entered, and all details have been
entered in the correct format [BR2].
5.1. IF mandatory details have not been provided and/or details have been entered in the incorrect
format the system displays an error message informing the Actor of the mandatory details
that must be provided and/or the invalid details that must be re-entered. [MSG0019]
5.1.1. The Actor acknowledges the message and the Use Case resumes at Basic Flow Step 2.
6. The System validates that a Person does not exist with the Email address provided.
6.1. IF an existing Person is found with the Email address provided, refer to AF1.
7. The system invokes UC96 Perform Postcode Address Lookup to search for the address
corresponding to the Post code entered.
8. The System populates the address fields with the selected matching address and the Use Case
resumes at Step 9 of the Basic Flow.
8.1. IF no address matches the Post code entered, the system informs the Actor there are no
matching addresses, and prompts the Actor to confirm they have entered the correct Postcode
[MSG0049].
8.1.1. The Actor acknowledges the message indicating that the Post code they have entered is
correct and the Use Case resumes at Step 9 of the Basic Flow making editable the
Address fields to be populated by the Actor.
8.1.1.1. IF the Actor acknowledges the message indicating that the Post code they have
entered is incorrect, the Use Case resumes at Step 2 of the Basic Flow.
8.2. IF there are matching addresses but the Actor does not select one, the Use Case resumes at
Step 9 of the Basic Flow without populating the address but making editable the Address
fields.
Control Points(Example)
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
4. The Actor enters the information and selects the option to continue.
5. The System validates that all mandatory details have been entered, and all details have been
entered in the correct format [BR2].
5.1. IF mandatory details have not been provided and/or details have been entered in the incorrect
format the system displays an error message informing the Actor of the mandatory details
that must be provided and/or the invalid details that must be re-entered. [MSG0019]
5.1.1. The Actor acknowledges the message and the Use Case resumes at Basic Flow Step 2.
6. The System validates that a Person does not exist with the Email address provided.
6.1. IF an existing Person is found with the Email address provided, refer to AF1.
7. The system invokes UC96 Perform Postcode Address Lookup to search for the address
corresponding to the Post code entered.
8. The System populates the address fields with the selected matching address and the Use Case
resumes at Step 9 of the Basic Flow.
8.1. IF no address matches the Post code entered, the system informs the Actor there are no
matching addresses, and prompts the Actor to confirm they have entered the correct Postcode
[MSG0049].
8.1.1. The Actor acknowledges the message indicating that the Post code they have entered is
correct and the Use Case resumes at Step 9 of the Basic Flow making editable the
Address fields to be populated by the Actor.
8.1.1.1. IF the Actor acknowledges the message indicating that the Post code they have
entered is incorrect, the Use Case resumes at Step 2 of the Basic Flow.
8.2. IF there are matching addresses but the Actor does not select one, the Use Case resumes at
Step 9 of the Basic Flow without populating the address but making editable the Address
fields.
?
Control Points(Example)
Control
Point Id Step
Next
Step
Included
in Test
Case Condition
Business
Rule /
PreCond
3a+ BF4 BF5 User selects option to continue TC1
4a- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with < 5 characters BR2 TC6
4b- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 7 characters BR2 TC6
4c- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
numeric BR2 TC6
4d+ BF5 BF6
Verify that entry is accepted when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
alphabetic BR2 TC1
4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6
4f- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with < 5 numerics BR2 TC6
4g- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with > 5 numerics BR2 TC6
4h- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with 5 characters including non- numerics BR2 TC2
5a+ BF6 AF1
Enter person with valid email address already
registered TC1
5b+ BF6 BF7 Enter person without email address already registered TC2
6a+ BF8 BF9
Verify that addresses are displayed where a valid post
code is entered which matches address
6b- BF8 BF8.1.1
Verify that MSG0049 is displayed when post code is
entered for which there are no matching addresses
7a+ BF8 BF9
Verify that when user responds to MSG0049 confirming
PostCode is correct then address fields are made
enterable
7b+ BF8 BF2
User responds to MSG0049 confirming PostCode is not
correct and reenters post code
8a+ BF8 BF9
Verify that when user selects an address then the screen
address fields are populated
8b+ BF8 BF9
Verify that when user does not accept an address then
screen address fields are made enterable
9a+ BF10 BF11
Enter Position, Business Name, Address, Subub, Town,
County, Language Preference, Daytime Phone Numer,
Evening Phone Number, Mobile Phone Number, 'How
did You Find Out Question', Contact By ABC Rep?
(Default No)
10a+ BF10 BF11
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed.
11a- BF11 End
Verify that Address, Town, Language, one of phone
numbers, 'How Did You Find Out' - are mandatory and
MSG0023 displayed if not entered
11b- BF11 End
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed and mandatory and MSG0023 displayed if not
entered
11c- BF11 End
Verify that Title, Forename, Surname, Email Address,
Confirmation Email Address, Country are mandatory and
MSG0023 displayed if not entered.
12a+ BF11 BF12
Verify that where user selected option to be contacted
by ABC rep then system generates reminder SGE0023.
Control
Point Id Step
Next
Step
Included
in Test
Case Condition
Business
Rule /
PreCond
3a+ BF4 BF5 User selects option to continue TC1
4a- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with < 5 characters BR2 TC6
4b- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 7 characters BR2 TC6
4c- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
numeric BR2 TC6
4d+ BF5 BF6
Verify that entry is accepted when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
alphabetic BR2 TC1
4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6
4f- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with < 5 numerics BR2 TC6
4g- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with > 5 numerics BR2 TC6
4h- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with 5 characters including non- numerics BR2 TC2
5a+ BF6 AF1
Enter person with valid email address already
registered TC1
5b+ BF6 BF7 Enter person without email address already registered TC2
6a+ BF8 BF9
Verify that addresses are displayed where a valid post
code is entered which matches address
6b- BF8 BF8.1.1
Verify that MSG0049 is displayed when post code is
entered for which there are no matching addresses
7a+ BF8 BF9
Verify that when user responds to MSG0049 confirming
PostCode is correct then address fields are made
enterable
7b+ BF8 BF2
User responds to MSG0049 confirming PostCode is not
correct and reenters post code
8a+ BF8 BF9
Verify that when user selects an address then the screen
address fields are populated
8b+ BF8 BF9
Verify that when user does not accept an address then
screen address fields are made enterable
9a+ BF10 BF11
Enter Position, Business Name, Address, Subub, Town,
County, Language Preference, Daytime Phone Numer,
Evening Phone Number, Mobile Phone Number, 'How
did You Find Out Question', Contact By ABC Rep?
(Default No)
10a+ BF10 BF11
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed.
11a- BF11 End
Verify that Address, Town, Language, one of phone
numbers, 'How Did You Find Out' - are mandatory and
MSG0023 displayed if not entered
11b- BF11 End
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed and mandatory and MSG0023 displayed if not
entered
11c- BF11 End
Verify that Title, Forename, Surname, Email Address,
Confirmation Email Address, Country are mandatory and
MSG0023 displayed if not entered.
12a+ BF11 BF12
Verify that where user selected option to be contacted
by ABC rep then system generates reminder SGE0023.
Control
Point Id Step
Next
Step
Included
in Test
Case Condition
Business
Rule /
PreCond
3a+ BF4 BF5 User selects option to continue TC1
4a- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with < 5 characters BR2 TC6
4b- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 7 characters BR2 TC6
4c- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
numeric BR2 TC6
4d+ BF5 BF6
Verify that entry is accepted when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
alphabetic BR2 TC1
4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6
4f- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with < 5 numerics BR2 TC6
4g- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with > 5 numerics BR2 TC6
4h- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with 5 characters including non- numerics BR2 TC2
5a+ BF6 AF1
Enter person with valid email address already
registered TC1
5b+ BF6 BF7 Enter person without email address already registered TC2
6a+ BF8 BF9
Verify that addresses are displayed where a valid post
code is entered which matches address
6b- BF8 BF8.1.1
Verify that MSG0049 is displayed when post code is
entered for which there are no matching addresses
7a+ BF8 BF9
Verify that when user responds to MSG0049 confirming
PostCode is correct then address fields are made
enterable
7b+ BF8 BF2
User responds to MSG0049 confirming PostCode is not
correct and reenters post code
8a+ BF8 BF9
Verify that when user selects an address then the screen
address fields are populated
8b+ BF8 BF9
Verify that when user does not accept an address then
screen address fields are made enterable
9a+ BF10 BF11
Enter Position, Business Name, Address, Subub, Town,
County, Language Preference, Daytime Phone Numer,
Evening Phone Number, Mobile Phone Number, 'How
did You Find Out Question', Contact By ABC Rep?
(Default No)
10a+ BF10 BF11
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed.
11a- BF11 End
Verify that Address, Town, Language, one of phone
numbers, 'How Did You Find Out' - are mandatory and
MSG0023 displayed if not entered
11b- BF11 End
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed and mandatory and MSG0023 displayed if not
entered
11c- BF11 End
Verify that Title, Forename, Surname, Email Address,
Confirmation Email Address, Country are mandatory and
MSG0023 displayed if not entered.
12a+ BF11 BF12
Verify that where user selected option to be contacted
by ABC rep then system generates reminder SGE0023.
Control
Point Id Step
Next
Step
Included
in Test
Case Condition
Business
Rule /
PreCond
3a+ BF4 BF5 User selects option to continue TC1
4a- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with < 5 characters BR2 TC6
4b- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 7 characters BR2 TC6
4c- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
numeric BR2 TC6
4d+ BF5 BF6
Verify that entry is accepted when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
alphabetic BR2 TC1
4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6
4f- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with < 5 numerics BR2 TC6
4g- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with > 5 numerics BR2 TC6
4h- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with 5 characters including non- numerics BR2 TC2
5a+ BF6 AF1
Enter person with valid email address already
registered TC1
5b+ BF6 BF7 Enter person without email address already registered TC2
6a+ BF8 BF9
Verify that addresses are displayed where a valid post
code is entered which matches address
6b- BF8 BF8.1.1
Verify that MSG0049 is displayed when post code is
entered for which there are no matching addresses
7a+ BF8 BF9
Verify that when user responds to MSG0049 confirming
PostCode is correct then address fields are made
enterable
7b+ BF8 BF2
User responds to MSG0049 confirming PostCode is not
correct and reenters post code
8a+ BF8 BF9
Verify that when user selects an address then the screen
address fields are populated
8b+ BF8 BF9
Verify that when user does not accept an address then
screen address fields are made enterable
9a+ BF10 BF11
Enter Position, Business Name, Address, Subub, Town,
County, Language Preference, Daytime Phone Numer,
Evening Phone Number, Mobile Phone Number, 'How
did You Find Out Question', Contact By ABC Rep?
(Default No)
10a+ BF10 BF11
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed.
11a- BF11 End
Verify that Address, Town, Language, one of phone
numbers, 'How Did You Find Out' - are mandatory and
MSG0023 displayed if not entered
11b- BF11 End
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed and mandatory and MSG0023 displayed if not
entered
11c- BF11 End
Verify that Title, Forename, Surname, Email Address,
Confirmation Email Address, Country are mandatory and
MSG0023 displayed if not entered.
12a+ BF11 BF12
Verify that where user selected option to be contacted
by ABC rep then system generates reminder SGE0023.
Control
Point Id Step
Next
Step
Included
in Test
Case Condition
Business
Rule /
PreCond
3a+ BF4 BF5 User selects option to continue TC1
4a- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with < 5 characters BR2 TC6
4b- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 7 characters BR2 TC6
4c- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
numeric BR2 TC6
4d+ BF5 BF6
Verify that entry is accepted when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
alphabetic BR2 TC1
4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6
4f- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with < 5 numerics BR2 TC6
4g- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with > 5 numerics BR2 TC6
4h- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with 5 characters including non- numerics BR2 TC2
5a+ BF6 AF1
Enter person with valid email address already
registered TC1
5b+ BF6 BF7 Enter person without email address already registered TC2
6a+ BF8 BF9
Verify that addresses are displayed where a valid post
code is entered which matches address
6b- BF8 BF8.1.1
Verify that MSG0049 is displayed when post code is
entered for which there are no matching addresses
7a+ BF8 BF9
Verify that when user responds to MSG0049 confirming
PostCode is correct then address fields are made
enterable
7b+ BF8 BF2
User responds to MSG0049 confirming PostCode is not
correct and reenters post code
8a+ BF8 BF9
Verify that when user selects an address then the screen
address fields are populated
8b+ BF8 BF9
Verify that when user does not accept an address then
screen address fields are made enterable
9a+ BF10 BF11
Enter Position, Business Name, Address, Subub, Town,
County, Language Preference, Daytime Phone Numer,
Evening Phone Number, Mobile Phone Number, 'How
did You Find Out Question', Contact By ABC Rep?
(Default No)
10a+ BF10 BF11
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed.
11a- BF11 End
Verify that Address, Town, Language, one of phone
numbers, 'How Did You Find Out' - are mandatory and
MSG0023 displayed if not entered
11b- BF11 End
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed and mandatory and MSG0023 displayed if not
entered
11c- BF11 End
Verify that Title, Forename, Surname, Email Address,
Confirmation Email Address, Country are mandatory and
MSG0023 displayed if not entered.
12a+ BF11 BF12
Verify that where user selected option to be contacted
by ABC rep then system generates reminder SGE0023.
Control
Point Id Step
Next
Step
Included
in Test
Case Condition
Business
Rule /
PreCond
3a+ BF4 BF5 User selects option to continue TC1
4a- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with < 5 characters BR2 TC6
4b- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 7 characters BR2 TC6
4c- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
numeric BR2 TC6
4d+ BF5 BF6
Verify that entry is accepted when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
alphabetic BR2 TC1
4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6
4f- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with < 5 numerics BR2 TC6
4g- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with > 5 numerics BR2 TC6
4h- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with 5 characters including non- numerics BR2 TC2
5a+ BF6 AF1
Enter person with valid email address already
registered TC1
5b+ BF6 BF7 Enter person without email address already registered TC2
6a+ BF8 BF9
Verify that addresses are displayed where a valid post
code is entered which matches address
6b- BF8 BF8.1.1
Verify that MSG0049 is displayed when post code is
entered for which there are no matching addresses
7a+ BF8 BF9
Verify that when user responds to MSG0049 confirming
PostCode is correct then address fields are made
enterable
7b+ BF8 BF2
User responds to MSG0049 confirming PostCode is not
correct and reenters post code
8a+ BF8 BF9
Verify that when user selects an address then the screen
address fields are populated
8b+ BF8 BF9
Verify that when user does not accept an address then
screen address fields are made enterable
9a+ BF10 BF11
Enter Position, Business Name, Address, Subub, Town,
County, Language Preference, Daytime Phone Numer,
Evening Phone Number, Mobile Phone Number, 'How
did You Find Out Question', Contact By ABC Rep?
(Default No)
10a+ BF10 BF11
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed.
11a- BF11 End
Verify that Address, Town, Language, one of phone
numbers, 'How Did You Find Out' - are mandatory and
MSG0023 displayed if not entered
11b- BF11 End
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed and mandatory and MSG0023 displayed if not
entered
11c- BF11 End
Verify that Title, Forename, Surname, Email Address,
Confirmation Email Address, Country are mandatory and
MSG0023 displayed if not entered.
12a+ BF11 BF12
Verify that where user selected option to be contacted
by ABC rep then system generates reminder SGE0023.
Table formatshould be
appropriatefor test tool
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Control Points
Iteration Test
PlanUse Case
Specification
Easier / Faster verification 435 Rqmts Errors
Benefits
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
High Level Test Cases
Assemble Control Points into Test Cases
• One from each set per test case (exception for multiple negative tests)
• Highlight first-time use in BOLD (➙ Objective of test case)
• Update Control Points sheet with Test Case Id
• Control Points may or may not be re-used
• Check for efficiency
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Control
Point Id Step
Next
Step
Test
Case Condition
Business
Rule /
PreCond
1a+ BF1 BF2 User selects option to Register
2a+ BF2 BF3
User enters Title, Forename, Surname, Emai, Email Confirmation, Country, Other Country, Post Code,
Accept Terms and Conditions, Accept Contact by ABC, Agree to Sharing Details, Option to Continue
3a+ BF4 BF5 User selects option to continue
4a- BF5 End Verify MSG0019 is displayed when you enter PostCode for UK with < 5 characters BR2
4b- BF5 End Verify MSG0019 is displayed when you enter PostCode for UK with > 7 characters BR2
4c- BF5 End
Verify MSG0019 is displayed when you enter PostCode for UK with > 5 and < 7 characters where 1st
character is numeric BR2
4d+ BF5 BF6
Verify that entry is accepted when you enter PostCode for UK with > 5 and < 7 characters where 1st
character is alphabetic BR2
4e+ BF5 End Verify that French postcode with 5 numerics is accepted BR2
4f- BF5 End Verify MSG0019 is displayed when you enter French postcode with < 5 numerics BR2
4g- BF5 End Verify MSG0019 is displayed when you enter French postcode with > 5 numerics BR2
4h- BF5 End Verify MSG0019 is displayed when you enter French postcode with 5 characters including non- numerics BR2
5a+ BF6 AF1 Enter person with valid email address already registered
5b+ BF6 BF7 Enter person without email address already registered
6a+ BF8 BF9 Verify that addresses are displayed where a valid post code is entered which matches address
6b- BF8 BF8.1.1 Verify that MSG0049 is displayed when post code is entered for which there are no matching addresses
7a+ BF8 BF9
Verify that when user responds to MSG0049 confirming PostCode is correct then address fields are made
enterable
7b+ BF8 BF2 User responds to MSG0049 confirming PostCode is not correct and reenters post code
8a+ BF8 BF9 Verify that when user selects an address then the screen address fields are populated
8b+ BF8 BF9 Verify that when user does not accept an address then screen address fields are made enterable
9a+ BF10 BF11
Enter Position, Business Name, Address, Subub, Town, County, Language Preference, Daytime Phone
Numer, Evening Phone Number, Mobile Phone Number, 'How did You Find Out Question', Contact By ABC
Rep? (Default No)
10a+ BF10 BF11
Verify that where user selects 'How Did You Find out?' then fields Trade Sector and Christie and Co Office
are displayed.
11a- BF11 End
Verify that Address, Town, Language, one of phone numbers, 'How Did You Find Out' - are mandatory and
MSG0023 displayed if not entered
11b- BF11 End
Verify that where user selects 'How Did You Find out?' then fields Trade Sector and Christie and Co Office
are displayed and mandatory and MSG0023 displayed if not entered
11c- BF11 End
Verify that Title, Forename, Surname, Email Address, Confirmation Email Address, Country are mandatory
and MSG0023 displayed if not entered.
12a+ BF11 BF12
Verify that where user selected option to be contacted by ABC rep then system generates reminder
SGE0023.
13a+ BF12 BF13 Verify that System displays read only summary of details entered.
7i- BF8 AF05.1 TC19
Identify Subcontractors working activities are (I) the installation of security systems, including burglar alarms, closed
circuit televsion and public address systems.
8a+ BF11 BF12 TC1 Subcontractor confirms the Correspondence address retrieved
8b+ BF11 AF06.1 TC2 Subcontractor does not confirm the Correspondence address retrieved
9a+ BF17 BF18 TC1 Subcontractor indicates he has not previously received any payments and has no verification number
9b+ BF17 AF11.01TC2 Subcontractor indicates that he has previously received payments
10a+ BF18 BF19 TC1 Subcontractor selects Gross Tax Treatment
10b+ BF18 AF08.1 TC2 Subcontractor selects Net Tax Treatment
11a+ BF19 BF20 TC1 Use Subcontractor for whom there is no Agent record held against the SubContractor on ODS
11b+ BF19 AF07.1 TC3 Use Subcontractor for whom there is an Agent record held against the SubContractor on ODS
12a+ BF20 BF21 TC1 Verify that the system has created the Subcontractor record?
13a+ BF23 BF24 TC1 Subcontractor confirms 12 month activity history
13b+ BF23 AF09.1 TC3 Subcontractor does not have a full 12 month activity history
14a+ BF24 BF25 TC1 Contractor confirms Trading in the UK status BRUL62
14b- BF24 ? Contractor does not confirm Trading in the UK Status BRUL62
15a+ BF25 BF26 TC1
Subcontractor is Individual application passing the standard turnover test - Individual turnover >= £30k during period up
to 12 months preceding date of application BRUL77
High Level Test Cases(Example)
FLOW - Basic/Alt BF/AF1 BF BF BF BF BF BF BF BF BF BF Basic Flow
Test Case Ref
Test
Case1
Test
Case2
Test
Case3
Test
Case4
Test
Case5
Test
Case6
Test
Case7
Test
Case8
Test
Case9
Test
Case10
Test
Case 11
Test Case 12
Priority 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+
2a+ 2a+ 2a+ 2a+ 2a+ 2a+ 2a+
3a+ 3a+ 3a+ 3a+ 3a+ 3a+ 3a+
Steps/Verifications 4d+ 4e+ 4e+ 4e+ 4e+ 4a- 4b- 4c- 4f- 4g- 4h-
5a+ 5b+ 5b+ 5b+ 5b+ 4b-
(AF1) 6a+ 6a+ 6b+ 6b+ 4c-
8a+ 8b+ 7a+ 7b+ 4f-
9a+ 9a+ 9a+ 9a+ 4g-
10a+ 11a- 4h-
12a+ 11b-
13a+ 11c-
FLOW - Basic/Alt BF/AF1 BF BF BF BF BF BF BF BF BF BF Basic Flow
Test Case Ref
Test
Case1
Test
Case2
Test
Case3
Test
Case4
Test
Case5
Test
Case6
Test
Case7
Test
Case8
Test
Case9
Test
Case10
Test
Case 11
Test Case 12
Priority 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+
2a+ 2a+ 2a+ 2a+ 2a+ 2a+ 2a+
3a+ 3a+ 3a+ 3a+ 3a+ 3a+ 3a+
Steps/Verifications 4d+ 4e+ 4e+ 4e+ 4e+ 4a- 4b- 4c- 4f- 4g- 4h-
5a+ 5b+ 5b+ 5b+ 5b+ 4b-
(AF1) 6a+ 6a+ 6b+ 6b+ 4c-
8a+ 8b+ 7a+ 7b+ 4f-
9a+ 9a+ 9a+ 9a+ 4g-
10a+ 11a- 4h-
12a+ 11b-
13a+ 11c-
TC1
TC1
TC1
TC1
TC1
TC4
TC4
TC5
TC2
TC2
TC2
TC2TC3
TC6
TC6
TC6
TC6TC6
TC6
X X
FLOW - Basic/Alt BF/AF1 BF BF BF BF BF BF BF BF BF BF Basic Flow
Test Case Ref
Test
Case1
Test
Case2
Test
Case3
Test
Case4
Test
Case5
Test
Case6
Test
Case7
Test
Case8
Test
Case9
Test
Case10
Test
Case 11
Test Case 12
Priority 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+
2a+ 2a+ 2a+ 2a+ 2a+ 2a+ 2a+
3a+ 3a+ 3a+ 3a+ 3a+ 3a+ 3a+
Steps/Verifications 4d+ 4e+ 4e+ 4e+ 4e+ 4a- 4b- 4c- 4f- 4g- 4h-
5a+ 5b+ 5b+ 5b+ 5b+ 4b-
(AF1) 6a+ 6a+ 6b+ 6b+ 4c-
8a+ 8b+ 7a+ 7b+ 4f-
9a+ 9a+ 9a+ 9a+ 4g-
10a+ 13a+ 11a- 4h-
12a+ 11b-
13a+ 11c-
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
High Level Test Cases
Benefits
Coverage – conditions, rules
Identify repetition
Focus on objective(s) of each test case
Consistency
Negatives
Abstract
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Detailed Test Cases
Check Control Points
Clear „Steps‟ or „Verifications‟?
Executable test actions?
Automated Script/Macro
Find / Replace - references by Control Point text
Update Control Points sheet with Test Case Numbers
Transfer from Excel into Rational TestManager & mark key steps/verifications
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Detailed Test Case Design(Example)
FLOW - Basic/Alt BF/AF1 BF BF BF BF BF BF BF BF BF BF Basic Flow
Test Case Ref
Test
Case1
Test
Case2
Test
Case3
Test
Case4
Test
Case5
Test
Case6
Test
Case7
Test
Case8
Test
Case9
Test
Case10
Test
Case 11
Test Case 12
Priority 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+
2a+ 2a+ 2a+ 2a+ 2a+ 2a+ 2a+
3a+ 3a+ 3a+ 3a+ 3a+ 3a+ 3a+
Steps/Verifications 4d+ 4e+ 4e+ 4e+ 4e+ 4a- 4b- 4c- 4f- 4g- 4h-
5a+ 5b+ 5b+ 5b+ 5b+ 4b-
(AF1) 6a+ 6a+ 6b+ 6b+ 4c-
8a+ 8b+ 7a+ 7b+ 4f-
9a+ 9a+ 9a+ 9a+ 4g-
10a+ 11a- 4h-
12a+ 11b-
13a+ 11c-
Control
Point Id Step
Next
Step
Included
in Test
Case Condition
Business
Rule /
PreCond
3a+ BF4 BF5 User selects option to continue TC1
4a- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with < 5 characters BR2 TC6
4b- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 7 characters BR2 TC6
4c- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
numeric BR2 TC6
4d+ BF5 BF6
Verify that entry is accepted when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
alphabetic BR2 TC1
4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6
4f- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with < 5 numerics BR2 TC6
4g- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with > 5 numerics BR2 TC6
4h- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with 5 characters including non- numerics BR2 TC2
5a+ BF6 AF1
Enter person with valid email address already
registered TC1
5b+ BF6 BF7 Enter person without email address already registered TC2
6a+ BF8 BF9
Verify that addresses are displayed where a valid post
code is entered which matches address
6b- BF8 BF8.1.1
Verify that MSG0049 is displayed when post code is
entered for which there are no matching addresses
7a+ BF8 BF9
Verify that when user responds to MSG0049 confirming
PostCode is correct then address fields are made
enterable
7b+ BF8 BF2
User responds to MSG0049 confirming PostCode is not
correct and reenters post code
8a+ BF8 BF9
Verify that when user selects an address then the screen
address fields are populated
8b+ BF8 BF9
Verify that when user does not accept an address then
screen address fields are made enterable
9a+ BF10 BF11
Enter Position, Business Name, Address, Subub, Town,
County, Language Preference, Daytime Phone Numer,
Evening Phone Number, Mobile Phone Number, 'How
did You Find Out Question', Contact By ABC Rep?
(Default No)
10a+ BF10 BF11
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed.
11a- BF11 End
Verify that Address, Town, Language, one of phone
numbers, 'How Did You Find Out' - are mandatory and
MSG0023 displayed if not entered
11b- BF11 End
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed and mandatory and MSG0023 displayed if not
entered
11c- BF11 End
Verify that Title, Forename, Surname, Email Address,
Confirmation Email Address, Country are mandatory and
MSG0023 displayed if not entered.
12a+ BF11 BF12
Verify that where user selected option to be contacted
by ABC rep then system generates reminder SGE0023.
Control
Point Id Step
Next
Step
Included
in Test
Case Condition
Business
Rule /
PreCond
3a+ BF4 BF5 User selects option to continue TC1
4a- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with < 5 characters BR2 TC6
4b- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 7 characters BR2 TC6
4c- BF5 End
Verify MSG0019 is displayed when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
numeric BR2 TC6
4d+ BF5 BF6
Verify that entry is accepted when you enter PostCode
for UK with > 5 and < 7 characters where 1st character is
alphabetic BR2 TC1
4e- BF5 End Verify that French postcode with 5 numerics is accepted BR2 TC6
4f- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with < 5 numerics BR2 TC6
4g- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with > 5 numerics BR2 TC6
4h- BF5 End
Verify MSG0019 is displayed when you enter French
postcode with 5 characters including non- numerics BR2 TC2
5a+ BF6 AF1
Enter person with valid email address already
registered TC1
5b+ BF6 BF7 Enter person without email address already registered TC2
6a+ BF8 BF9
Verify that addresses are displayed where a valid post
code is entered which matches address
6b- BF8 BF8.1.1
Verify that MSG0049 is displayed when post code is
entered for which there are no matching addresses
7a+ BF8 BF9
Verify that when user responds to MSG0049 confirming
PostCode is correct then address fields are made
enterable
7b+ BF8 BF2
User responds to MSG0049 confirming PostCode is not
correct and reenters post code
8a+ BF8 BF9
Verify that when user selects an address then the screen
address fields are populated
8b+ BF8 BF9
Verify that when user does not accept an address then
screen address fields are made enterable
9a+ BF10 BF11
Enter Position, Business Name, Address, Subub, Town,
County, Language Preference, Daytime Phone Numer,
Evening Phone Number, Mobile Phone Number, 'How
did You Find Out Question', Contact By ABC Rep?
(Default No)
10a+ BF10 BF11
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed.
11a- BF11 End
Verify that Address, Town, Language, one of phone
numbers, 'How Did You Find Out' - are mandatory and
MSG0023 displayed if not entered
11b- BF11 End
Verify that where user selects 'How Did You Find out?'
then fields Trade Sector and Christie and Co Office are
displayed and mandatory and MSG0023 displayed if not
entered
11c- BF11 End
Verify that Title, Forename, Surname, Email Address,
Confirmation Email Address, Country are mandatory and
MSG0023 displayed if not entered.
12a+ BF11 BF12
Verify that where user selected option to be contacted
by ABC rep then system generates reminder SGE0023.
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Detailed Test Case Design(Example)
FLOW - Basic/Alt BF/AF1 BF BF BF BF BF BF BF BF BF BF Basic Flow
Test Case Ref
Test
Case1
Test
Case2
Test
Case3
Test
Case4
Test
Case5
Test
Case6
Test
Case7
Test
Case8
Test
Case9
Test
Case10
Test
Case 11
Test Case 12
Priority 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+ 1a+
2a+ 2a+ 2a+ 2a+ 2a+ 2a+ 2a+
3a+ 3a+ 3a+ 3a+ 3a+ 3a+ 3a+
Steps/Verifications 4d+ 4e+ 4e+ 4e+ 4e+ 4a- 4b- 4c- 4f- 4g- 4h-
5a+ 5b+ 5b+ 5b+ 5b+ 4b-
(AF1) 6a+ 6a+ 6b+ 6b+ 4c-
8a+ 8b+ 7a+ 7b+ 4f-
9a+ 9a+ 9a+ 9a+ 4g-
10a+ 11a- 4h-
12a+ 11b-
13a+ 11c-
Index Number 2 3
TestManager Test sys-UC001-fnc-002 sys-UC001-fnc-003
Priority (1- High, 2-
Medium, 3-Low) Priority 1 Priority 2 Alt Flow 1 Alt Flow 2 Alt Flow 3Flow (Basic Flow /
AF01 etc) BF BF2 BF2 BF2
AF1.1 BF3 BF3
Test Case Summary
Valid basic flow - French Post Code, person
without email address previously registered. User
selects 'How did you find out?'
Valid Basic Flow - user does not accept address
displayed for post code AF1.2 AF2.1 BF4
AF2.2 AF3.1
Test Case Steps User selects option to Register User selects option to Register AF2.3 AF3.2
User enters Title, Forename, Surname,
Emai, Email Confirmation, Country, Other
Country, Post Code, Accept Terms and
Conditions, Accept Contact by ABC, Agree to
Sharing Details, Option to Continue
User enters Title, Forename, Surname, Emai,
Email Confirmation, Country, Other Country,
Post Code, Accept Terms and Conditions,
Accept Contact by ABC, Agree to Sharing
Details, Option to Continue AF3.3
User selects option to continue User selects option to continue
Verify that French postcode with 5 numerics
is accepted?
Verify that French postcode with 5 numerics is
accepted?
Enter person without email address already
registered
Enter person without email address already
registered
Verify that addresses are displayed where a
valid post code is entered which matches
address?
Verify that addresses are displayed where a valid
post code is entered which matches address?
Verify that when user selects an address
then the screen address fields are
populated?
Verify that when user does not accept an
address then screen address fields are
made enterable
Enter Position, Business Name, Address,
Subub, Town, County, Language
Preference, Daytime Phone Numer, Evening
Phone Number, Mobile Phone Number, 'How
did You Find Out Question', Contact By ABC
Rep? (Default No)
Enter Position, Business Name, Address,
Subub, Town, County, Language Preference,
Daytime Phone Numer, Evening Phone Number,
Mobile Phone Number, 'How did You Find Out
Question', Contact By ABC Rep? (Default No)
Verify that where user selects 'How Did You
Find out?' then fields Trade Sector and ABC
Offices are displayed.?
Verify that System displays read only summary
of details entered.?
Verify that where user selected option to be
contacted by ABC rep then system generates
reminder SGE0023.?
Verify that System displays read only
summary of details entered.?
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Lessons Learned
Lessons Learned
• Flow charts
• Single Flows
• Over-complex
• Referencing
• Over-large test cases
• Test Data – Embedded or external?
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Tips
Expect changes
• Address one at a time
• Do we need to do this?
• Could we do it smarter?
• Is it repetitive ➙ automation?
Focus on “Why?” before “How?”
Tools
• Does it do what I need?
• Can I use what I already have?
-
Capgemini Technology Services© 2005 Capgemini - All rights reserved
Eurostar 2005
Benefits
Traceability – easier to implement change
Consistency – easier to share work
Metrics & Estimation
Easier to QA -
-
Systematic Test Design –
A Smarter Strategy?
For us -
“Definitely”
Try it!