cs 49000-st0 software testing spring 2011 review last updated: april 26, 2011 aditya p. mathur...
TRANSCRIPT
![Page 1: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/1.jpg)
CS 49000-ST0 Software TestingSpring 2011
Review
Last updated: April 26, 2011
Aditya P. MathurPurdue University
![Page 2: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/2.jpg)
Learning Objectives
• Various test processes and continuous quality improvement
• Types of errors and fault models
• Methods of test generation from requirements
• Behavior modeling using UML: Finite state machines (FSM)
• Test generation from FSM models
2
![Page 3: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/3.jpg)
Learning Objectives (contd)
• Input space modeling using combinatorial designs
• Combinatorial test generation
• Test adequacy assessment using: control flow, data flow, and program mutations
• The use of various test tools
• Application of software testing techniques in commercial environments
3
![Page 4: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/4.jpg)
Test processes and continuous quality improvement
4
Test metrics: Chapter 1.6
Test plan: Chapter 1.5
Defect management: Chapter 1.9
Walkthroughs and inspection: Chapter 1.12
Test process models: Chapter 1.18.5
![Page 5: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/5.jpg)
Types of errors and fault models
5
Chapter 1.1
![Page 6: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/6.jpg)
Methods of test generation from requirements
6
Equivalence partitioning: Chapter 2.3
Boundary value analysis: Chapter 2.4
![Page 7: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/7.jpg)
Behavior modeling using UML: Finite state machines (FSM)
7
Microsoft project
AEC project: parsing
FSM basics: Chapter 3.2
![Page 8: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/8.jpg)
Test generation from FSM models
8
Spec Explorer
W-method: Chapter 3.6
State, transition, and switch covers: Chapter 3.9
![Page 9: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/9.jpg)
Input space modeling using combinatorial designs
9
Test configurations and modeling the input space: Chapter 4.1
Fault model: Chapter 4.3
![Page 10: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/10.jpg)
Combinatorial test generation
10
MOLS: 4.8
Covering arrays: 4.9, 4.10, 4.11
![Page 11: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/11.jpg)
Test adequacy assessment using: control flow, data flow, and program mutations
11
Basics: 6.1
Criteria based on control flow: 6.2 (excluded 6.2.7)
Criteria based on data flow: 6.3, 6.4.1, 6.4.2, 6.4.3
![Page 12: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/12.jpg)
The use of various test tools
12
Load and performance testing: JMeter
GUI testing: Abbot, Guitar
Combinatorial testing: AETG, FireEye
Unit testing: Achoo, JUnit, Pex/Moles, PyUnit
Model based testing testing: Spec Explorer
Coverage analysis: Corbertura
Defect management: Bugzilla
Test automation: TestComplete
Concurrency: ConTest
![Page 13: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/13.jpg)
Application of software testing techniques in commercial environments
13
AEC project
Microsoft project
Some Spec Explorer Statistics [MS]:Team Size test cases 600 798 158
8178 100 100 60 164 40 40 30
900 20 629 18 3000
13 1900 10 150 10 60 8
28
Some Spec Explorer Statistics [Customers]:Team Size test cases 20 128212
250
![Page 14: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/14.jpg)
What did we not cover [1]?
14
Regression testing (Chapter 5)
Mutation testing (for test adequacy and enhancement; Chapter 7)
Test generation from statecharts
Test generation from timed-automata for real-time systems
Test generation from formal specification (e.g.; Z)
Testing concurrent programs
![Page 15: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/15.jpg)
What did we not cover [2]?
15
Test process
Test automation
Error types and classification method
![Page 16: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/16.jpg)
Final Examination
16
Tuesday May 3. 8-10am. Smith 208
Part A: Multiple choice, comprehensive [Closed book/notes]
Part B: Few questions (3 or 4) [Open book/notes]
FSM-based test generation, Combinatorial designs, Test adequacy
![Page 17: CS 49000-ST0 Software Testing Spring 2011 Review Last updated: April 26, 2011 Aditya P. Mathur Purdue University](https://reader036.vdocuments.us/reader036/viewer/2022082713/56649f125503460f94c265a9/html5/thumbnails/17.jpg)
17
Good luck!
Best wishes!