the big three what are the three most common complaints we hear about testing?
TRANSCRIPT
![Page 1: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/1.jpg)
![Page 2: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/2.jpg)
The Big Three
What are the three most common complaints we hear about testing?
![Page 3: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/3.jpg)
Problem 1
• Missing or incomplete requirements
• Why? legacy application: cannot find the old
documentation Modified application: original requirements not
kept up to date.
• Impact? Difficult to maintain Difficult to test
![Page 4: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/4.jpg)
Solution 1
• Behavioral Modeling creates a communication vehicle between the business and test engineers.
• Result: Common understanding of the application Reverse engineered requirements Easier to maintain and modify
![Page 5: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/5.jpg)
Problem 2
• Testing takes too long!
• Why? Too many test cases Redundant tests
• Impact? Cost of testing is too high Applications delayed into production
![Page 6: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/6.jpg)
Solution 2
• Behavior Modeling identifies the minimum necessary number of test cases.
• In case studies, the number of test cases reduced by 75 to 90%
• Result: Less testing Less delay Less cost
![Page 7: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/7.jpg)
Problem 3
• Testing can miss bugs!
• Why? Test Suites are missing some functional
paths or conditions
• Impact? Defects deployed to production Costs to repair MUCH higher
![Page 8: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/8.jpg)
Solution 3
• Behavioral Modeling identifies all the functional paths of an application.
• Result: Test suite will not miss any bugs Fewer production problems Less cost
![Page 9: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/9.jpg)
Behavioral Modeling: What is it?
• A graphical representation…• ...of the functional behavior…• …of the software article.
![Page 10: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/10.jpg)
What does it buy us?
• Allows the behavior to be specified at any level of detail.
• Allows different people to work on different sections at the same time.
• Limited “vocabulary” enforces a high level of consistency in the models.
• Allows understanding (and review) by people with a wide variety of experience.
![Page 11: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/11.jpg)
Vocabulary
Beginning or End Process
ChoiceCase
Result Displayed Result
Manual ActionRepresentative
Sample
Curved Line Connector
Note
Straight Line Connector
![Page 12: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/12.jpg)
How do we do it?
• What does it do?– “Do” in the active sense
• What influences it?
There are only two questions --
![Page 13: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/13.jpg)
Sample Problem 1
• Externals only• Example –
Bigger:
Two numbers in
One number out
+1 if 1st number bigger than 2nd
-1 if 1st number smaller than 2nd
0 if the numbers are equal
![Page 14: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/14.jpg)
Bigger
1st Number
result =+1 result = 0 result = -1
bigger than 2nd
equals 2nd
less than 2nd
End
![Page 15: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/15.jpg)
Bigger
1st Number
bigger than 2nd
equals 2nd
less than 2nd
End
2 values input
no1st number
valid
no
2nd number valid
no
yes
yes
yes
result =+1 result = 0 result =-1
UNSPECIFIED!!
![Page 16: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/16.jpg)
Sample Problem 2
• FAST– The Functionally Advanced Sidewalk Teller
• Deposit• Withdraw• Transfer• Check Balance
![Page 17: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/17.jpg)
FAST
Deposit Withdraw Transfer Balance
End
![Page 18: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/18.jpg)
FAST
Deposit Withdraw Transfer Balance
End
Signon
![Page 19: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/19.jpg)
FAST
Deposit Withdraw Transfer Balance
End
Signon Exceptions
![Page 20: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/20.jpg)
FAST
Deposit
WithdrawTransfer
Balance
End
Sign On Exceptions
String
![Page 21: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/21.jpg)
FAST
Deposit
Withdraw
Transfer
Balance
End
Sign On
Exceptions
String
![Page 22: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/22.jpg)
Sign-on
End
Valid FASTcard
"This is not aFAST card."
Card returned
No
Account(s) stillopen
Yes
"This card is nolonger valid."
Card retained byFAST
No
User signed on.Main menudisplayed.
Yes
From FAST
![Page 23: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/23.jpg)
Deposit
Exists Exists
"Requested Account Does Not Exist. Re-
enter"
Checking Savings
NoNo
YesYes
End
Account Updated
To account
From FAST
![Page 24: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/24.jpg)
Deposit
Exists
"Requested Account Does Not Exist. Re-enter or exit"
Checking Savings
No
yes
Yes
End
To account
Account Updated
continue
no
From FAST
![Page 25: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/25.jpg)
Withdraw
Exists
"Requested Account Does Not Exist. Re-
enter"
No
yes
Yes
Yes
End
Enough in account
"Insufficient Funds in
account. Re-enter or quit"
No
yes
Enough in FAST
"Insufficient Funds in
FAST. Reenter or quit" No
yes
Yes
yes
Money dispensed and
account Updated
Amount entered
continue
no
continue
no
From FAST
continue
no
No
Checking Savings
To account
![Page 26: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/26.jpg)
Transfer
From account
Exists
Checking Savings
"From account does
not exist
no
To account
Exists
Checking Savings
"To account does not exist
no
yes
same as from
"To and From accounts cannot
be the same. Reenter or quit."
yes
yes
no
enougn in account
yes "Insufficient funds in ‘From’
account. Reenter or quit."
no
yes
money transferred and
accounts updated.
yes
End
continue
no
Amount entered
continue
no
From FAST
![Page 27: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/27.jpg)
Balance
End
account
exists
Checking Savings
Balance displayed
yesno
"Requested account does
not exist."
From FAST
![Page 28: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/28.jpg)
Exceptions
End
"This machine is temporarily
out of service."
Out of paper
FAST out of cash
Cancel
Transaction canceled.
Display returns to main menu.
during balance during
deposit during sign-on
duringtransfer
duringwithdraw
From FAST
![Page 29: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/29.jpg)
balance
deposit
withdraw
String
End
deposit
withdraw
balance
Everything is lovely
From FAST
signon signon
![Page 30: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/30.jpg)
• Issues?• Questions?• Comments?• Concerns?
– On anything we have covered so far
![Page 31: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/31.jpg)
Attributes of Good Test Suites
• Effective • Efficient
![Page 32: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/32.jpg)
Deposit
Exists
"Requested Account Does Not Exist. Re-enter or exit"
Checking Savings
No
yes
Yes
End
To account
Account Updated
continue
no
From FAST
![Page 33: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/33.jpg)
Deposit
Exists
"Requested Account Does Not Exist. Re-enter or exit"
Checking Savings
No
yes
Yes
End
To account
Account Updated
continue
no
From FAST
![Page 34: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/34.jpg)
Deposit
Exists
"Requested Account Does Not Exist. Re-enter or exit"
Checking Savings
No
yes
Yes
End
To account
Account Updated
continue
no
From FAST
![Page 35: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/35.jpg)
Deposit
Exists
"Requested Account Does Not Exist. Re-enter or exit"
Checking Savings
No
yes
Yes
End
To account
Account Updated
continue
no
From FAST
1st pass
1st pass
![Page 36: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/36.jpg)
Next Steps
• Test Design Review
• Test Case Design
![Page 37: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/37.jpg)
TCD ID:Description:
Author: Original Release: Date:
Test Case:Control Points:
Expected Results
Test Case Design Template
![Page 38: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/38.jpg)
Test Case Design Sample
TCD ID: FDDescription: FAST Deposit
Author: Shel PrinceOriginal Release: 1.0 Date: 9/6/20xx
Test case: FD01 FD02 FD03Control Points:To Account: * * *
Checking * * *Savings *
Account exists? Y N N/YContinue: * * *
yes * *no *
FA
ST
exi
t; c
ard
is r
etur
ned.
Aft
er t
he a
ccou
nt c
hoic
e is
co
rrec
ted,
the
acc
ount
bal
ance
is
upda
ted
with
the
dep
osite
d am
ount
.
Expected Results
Acc
ount
bal
ance
upd
ated
with
the
dep
osite
d am
ount
.
Msg: "requested account does not exist. Reenter
or Quit."
![Page 39: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/39.jpg)
Test Case Specification
– Test Case ID– Test Items– Input– Expected Output– Environmental Needs– Special Procedural Requirements– Inter-test case Dependencies– Actual Steps…
![Page 40: The Big Three What are the three most common complaints we hear about testing?](https://reader035.vdocuments.us/reader035/viewer/2022062807/5697c00e1a28abf838cc9c33/html5/thumbnails/40.jpg)
• Issues?• Questions?• Comments?• Concerns?