8/27/20151nest controlled. 2 communication transportation education banking home applications
TRANSCRIPT
04/21/23 1NeST Controlled
2
Defective SoftwareLeads to
Loss of market reputation business opportunities
April 21, 2023 NeST Controlled 3
Casualties like injuries and death
Loss of Time
Loss of Money
04/21/23 NeST Controlled 4
What is Testing??
Former Thoughts
NeST Controlled 5
Establish confidence that a program does what it is supposed to do (Hetzel, 1973)
Former Thoughts
NeST Controlled 6
The process of executing a program or system with the intent of finding errors (Myers, 1979)
April 21, 2023 NeST Controlled 7
Detecting specification errors and deviations from the specifications
Former Thoughts
April 21, 2023 NeST Controlled 8
Verifying that a system satisfies its specified requirements and identifying the differences between
expected and actual results
Former Thoughts
What could be testing?
April 21, 2023 NeST Controlled 9
Primary role of testing is not demonstration of correct performance, but the exposure of hidden defects
G.J.Myers
Software testers do not make
software; they only make them
better.
Software testers do not make
software; they only make them
better.
Success of an
organization depend on
the success of testers.
Success of an
organization depend on
the success of testers.
April 21, 2023 NeST Controlled 11
Who is a Tester?Who is a Tester?
A Devil
An Angel
Role of Testing
April 21, 2023 NeST Controlled 12
Testing – A part of Software Lifecycle
April 21, 2023 NeST Controlled 13
"Software Testing Techniques" by Boris Beizer
"Software Testing Techniques" by Boris Beizer
The thinking that must be done to create a
useful test can discover and eliminate bugs
before they are coded - indeed, test-design
thinking can discover and eliminate bugs at
every stage in the creation of software, from conception to
specification, to design, coding and the rest
The Challenge
April 21, 2023 NeST Controlled 14
A Miss will result in hit from customer!!
The last phase of testing happens at customer site.
The Lacuna
April 21, 2023 NeST Controlled 15
RequirementRequirementDesignDesign CodeCode TestingTesting
The Planned
RequirementRequirement DesignDesign CodeCode TestingTesting
The Actual
The Challenge
April 21, 2023 NeST Controlled 16
Among 22 PAs in CMMI,
testing was wrapped
into two Process areas
alone.
Aim is to establish
testing as the part and
parcel of development
lifecycle.
ARRIVAL OF TMMi
Earlier testing was unpredictable and hectic.
No effective plan, monitor, control & management.
To meet high quality standards, high speed, profitability and to reduce cost TMMi was introduced.
TMMiTest Maturity Model Integration.
Unmanaged Managed
Undefined Defined
Ad-hoc Measured
Optimized
Helps to meet the business objectives.
Open model which
incorporates good practices for testing for test process
improvement.
Structure of TMMi5)Optimization Defect preventionTest process Optimization Quality control
4)MeasuredTest measurementSoftware quality evaluationAdvanced peer reviews
3)DefinedTest organizationTest training programTest lifecycle & integrationNon-Functional TestingPeer reviews
2)ManagedTest policy & StrategyTest planningTest Monitoring & ControlTest Design & ExecutionTest Environment
1)Initial
Managed Existing practices retained during time of stress.
04/21/23 NeST Controlled 20
Test Policy & Strategy
Test policy based on the business objective
Test Planning
Test Monitoring & Control
Test Design & Execution
Test Environment
Test plan developed & Test approach is defined in test plan.
Cross checks the values with the planned parameters.
Identifies test conditions, test cases and test data.
Should resemble the real-life situation.
Model Requirements
Managed
04/21/23 NeST Controlled 21
Effective Implementations
Communicate with relevant stakeholders about Test Policy & Strategy
By the help of checklist can ensure all the aspects of testing strategies are addressed in the initial stage.
Breakdown structure prepared & estimates done for each.
April 21, 2023 NeST Controlled 22
Test Planning
Test Plan
Test Policy
Testing risks
Testing objectives
Testability
Scope of testing
Resource availability
Testing constraints
Criticality
Managed
04/21/23 NeST Controlled 23
Effective Implementations
Weekly meetings & Milestone analysis
Bug Trend Graph
Defined Not just confined to a phase that follows coding
04/21/23 NeST Controlled 24
Test Organization Identify & organize a group of highly skilled people for testing.
Test Training Program
Test Lifecycle & Integration
Non-Functional Testing
Peer Review
Conducts in-house testing certification program & workshops & feed backs collected.
Sync test life cycle with development life cycle.
Performance, Load, Stress, Usability, Maintainability, Reliability testing are included.
Verify requirements met & defects from selected products removed early.
Model RequirementsFully integrated to development lifecycle & associated milestone.
Defined
04/21/23 NeST Controlled 25
Effective Implementations
Training Feedbacks should be collected
Tool Failure Mode Effective Analysis is used for risk analysis.
Defined
04/21/23 NeST Controlled 26
Effective Implementations
Test cases Identified & Prioritized.
Different reviews adopted: Formal review Semi-Formal Walk through
MeasuredTesting is thoroughly defined, well founded and measurable
process.
04/21/23 NeST Controlled 27
Test Measurement
Product Quality Evaluation
Advanced Peer Review
Identify, collect, analyze and apply measurements.
Quantitative understanding of the quality of the product.
Peer review(static testing) with dynamic testing.
Model Requirements
Measured
04/21/23 NeST Controlled 28
Effective Implementations
Metrics
You can manage, what you can measureYou can manage, what you can measure
You can measure, what you can defineYou can measure, what you can define
You can define, what you understand.You can define, what you understand.
Measured
04/21/23 NeST Controlled 29
Effective Implementations
Metrics
Measured
04/21/23 NeST Controlled 30
Effective Implementations
Progress quantitatively managed & measured throughout the lifecycle.
Coordination obtained by bi-directional traceability.
OptimizedImproving process based on quantitative understanding of
statically controlled process.
04/21/23 NeST Controlled 31
Defect Prevention
Quality Control
Test Process Optimization
Root cause and common cause of defects analyzed.
Statistically controlled & managed test process.
Continually improves the existing testing process.Identifies new testing process, tools, methods.
Model Requirements
Optimized
04/21/23 NeST Controlled 32
Effective Implementations
Processes are statistical managed using Process Performance Model.
PPM can be built for parameters like test execution rate, testing effectiveness etc.
Re-use Test Assets across organization
Process performance models
33
Process Performance Model can be used forPredicting the performance of
the identified critical parameter within the project
Choosing the quantitative parameters and specification limits for statistical management
Testing effectiveness = 3.79+0.69*Expertise-6.78*Complexity of the product+4.71*% test case executed
PROCESS PERFORMANCE MODELS
Testing effectiveness = 3.79+0.69*Expertise-6.78*Complexity of the product+4.71*% test case executed.
Control charts shall be used for quantitative management of the selected sub process parameters inside the project
34
ConclusionTMMi helps to bring about greater clarity and an increase in
productivity for the activities of the testing phase.
By implementing each process areas of testing process efficiently, we can understand the importance of testing throughout the life cycle.
04/21/23 NeST Controlled 35
04/21/23 NeST Controlled 36
04/21/23 37NeST Controlled