sap - redefining software · pdf filedependencies between modules are ... c1 c2 c3 c5 c4 c6...
TRANSCRIPT
![Page 1: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/1.jpg)
SAP - Redefining software testing
Sanujeet Puhan
SAP Technical Architect
![Page 2: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/2.jpg)
Overview
• Application softwares
• Enterprise applications
• Current trends
Test Approach
• Applications vs Processes
• Risk perspective
• Critical questions
Methods and Tools
• Business blueprint
• Technical Bill of Material
• Impact Analysis
• Test plan simulation
Agenda
![Page 3: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/3.jpg)
Application softwares
Custom application, supports specific
functions/services
Standard application, can be combined to provide
specific functions/services
Enterprise application, provides range of standard
enterprise functions and services
Systems
Applications
Products
![Page 4: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/4.jpg)
Enterprise Applications
A whole bunch of domains
FI,MM,SD…many unused
Tightly integrated
Change means side-effects
Vendor specific Data model
Client has limited view
![Page 5: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/5.jpg)
SAP Testing situation
Source: ASUG Test influence council member survey 2010
![Page 6: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/6.jpg)
Customer software vs Standard erp software 1(4)
Focus
Custom software Standard software
Thinking in terms of Applications Focus on - Bug-free operation, - Ergonomics of user interface, - Compact solutions
Thinking in terms of Business Processes Focus on - Quick deployment, - Robust business processes, - separation and standardization
How it matters for testing
Major tests are: - Unit testing (code quality) - Whitebox testing (coverage) - Exploratory testing (exception)
Most tests are: - Integration testing - Blackbox testing - Regression testing
![Page 7: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/7.jpg)
Customer software vs Standard erp software 2(4)
Development
Custom software Standard software
Coding is a major activity. Typical cycle is:
Coding is only for enhancements. Typical cycle:
Design
Build
Test
Deploy
Design
Configure
Test
Deploy
How it matters for testing
Since coding is a major activity, Testing involves developers.
Needs good data quality. Testing requires business process experts.
![Page 8: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/8.jpg)
Customer software vs Standard erp software 3(4)
Change control
Custom software Standard software
Changes triggered by - new user requirements - obsolescence
Changes triggered by - User requirements - Obsolescence - Vendor’s strategy
How it matters for testing
Since customer is in control, Frequency of testing is less.
As vendor updates must be applied, Regression Testing is frequently done.
![Page 9: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/9.jpg)
Customer software vs Standard erp software 4(4)
Custom software Standard software
Self architected, meaning Dependencies between modules are usually well-known.
Predefined architecture, meaning Many dependencies maybe unclear.
How it matters for testing
Test scope can be decided with good accuracy.
Test scope can become large, to account for hidden dependencies.
Dependencies
![Page 10: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/10.jpg)
P1
P4
P2
Px
P3
P5
But “Test all” feasible ?
Px
P1 P2
P3 P4
P5
Test
bench
Test everything, it is safest
A typical test scenario
C1
C2
C3
C5
C4
C6
- too vast - too intricate
![Page 11: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/11.jpg)
P1
P4
P2
Px
P3
P5
Test
bench
Px
P1
P2
P5
P3
P4
Identify critical processes
Risk = Probability of failure * Cost of failure
But, what is the actual probability of failure ?
C1
C3 C4
C6
C2 C5
Risk based test approach
P1 P2 P5
P4 P3
![Page 12: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/12.jpg)
Critical Questions
How to
find processes with actual risk, NOT assumed risk
adapt test plan to resource constraints
![Page 13: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/13.jpg)
P1
P4
P2
Px
P3
P5
C1
C2
C3
C5
C4
C6
If process and code can be linked …
Then we know which processes are actually impacted
![Page 14: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/14.jpg)
8 steps, 6 affected by code changes
C1
C2
C3
C5
C4
C6
Scenario Coverage (%) Effort (min) Choice
S1 83.3 180
S2 83.3 315
S3 66.6 210
S4 66.6 315
S1
Test
bench
Px
P2
P5
P4
P3
An optimization example
S2 S3 S4
P1 P2 P5
P4 P3
Px
Links also indicate test effort
1
![Page 15: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/15.jpg)
How to:
Identify processes
with actual risk
Impact analysis
Adapt test plan to actual
resource constraints
Optimization
Test coverage
Test effort
process code /*
![Page 16: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/16.jpg)
A real life scenario:
New SAP Enhancements are applied, which changes many objects
![Page 17: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/17.jpg)
The need of a test strategy in SAP
![Page 18: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/18.jpg)
Business Blueprint SAP’s approach to unify processes, applications and systems
![Page 19: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/19.jpg)
Technical bill of materials Links process to underlying objects
![Page 20: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/20.jpg)
Impact Analysis
Determining which processes are affected
![Page 21: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/21.jpg)
Boundary setting Select a meaningful subset of packages
![Page 22: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/22.jpg)
Dashboarding Status and other aids for project management
![Page 23: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/23.jpg)
Test Scope Optimization
Optimization
based on:
Test coverage
Test effort
Business priority
Approach: All changed objects should be tested at least once.
![Page 24: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/24.jpg)
Actual Optimization Simulations with Coverage and Test effort
![Page 25: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/25.jpg)
Final checks
Identify / add anything missing
![Page 26: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/26.jpg)
Benefits
NEXT STEP:
Generate test plan, automate, assign testers, create learning maps …
Precise insight of change impact
Better risk management for business
Safeguard test case obsolescence with TBOMs
Timely identification of gaps in test scope
Multivariate optimization
Reduced effort for a requirement based test plan
![Page 27: SAP - Redefining software · PDF fileDependencies between modules are ... C1 C2 C3 C5 C4 C6 ... Test bench Px P1 P2 P5 P3 P4 Identify critical processes](https://reader031.vdocuments.us/reader031/viewer/2022022423/5a9df69b7f8b9adb388c6989/html5/thumbnails/27.jpg)
Thank you !