asug vip performance testing 2010

ATUL PATANKAR[ASUG INSTALLATION MEMBER MEMBER SINCE: 2000

LINDA WILSON[ASUG INSTALLATION MEMBER MEMBER SINCE: 1999

JUERGEN LINDNER[SAP POINT OF CONTACT MEMBER SINCE: 1998

[

] Ready for Go Live - Performance Testing

Your SAP System

[September 16, 2010Dan DeLanoVisionary Integration Professionals

[

Real Experience. Real Advantage.

2

Agenda

Topics for this presentation:

Introduction to Visionary Integration Professionals

The performance testing method.

Performance testing tools and architecture

VIP’s load test offering.

Open for questions

[


VIP at a Glance

3

• Founding: February 1996

• Over 800 Staff

• 11 Offices– Headquarters: Folsom, CA– Sacramento Metro– Washington DC Metro (2 offices)– New York City Metro– Dallas Metro– Houston Metro– Los Angeles Metro– Minneapolis Metro– Denver Metro– Bangalore, India

• HP Gold Elite Partner since 1997

• Over 50+ HP Software Product Consultants on Staff

• TOP SECRET Clearance from the US Department of Defense

Jeff Bettcher, VP of QM Sales Dan DeLano, Velocity Architect Kelli Schnieder, Director of QM [email protected] [email protected] [email protected]

(303) 470-6254 (303) 594-0961 (612) 226-1657

• Six Solution Offerings– Quality Management– SAP Consulting and Integration– Business Intelligence and Data Warehousing– Human Capital Management Solutions– Technology Integration and Operations– Management Consulting

• Successfully delivered quality solutions to 900+ Clients in commercial and public sectors

mailto:[email protected]



[


Solution Offering – Quality Management

4

HP Certified Software Product Specialists & Instructors

- LoadRunner™ - QuickTestPro™

- Quality Center™ - Business Availability Center™

- Performance Center™

• ERP/CRM Testing including SAP, JD Edwards, PeopleSoft, Oracle, Lawson, Siebel

• HP Product Sales

• HP Product Training and Mentorship

• HP Production Implementation

• Best Practices Assessments

• Methodology & Framework Implementation

• Business Quality Testing

• Out-Sourced Testing Solutions

• Automated Functional Software Testing

• Performance Testing and Tuning

• Data Quality Analysis- Data Warehouse and Business Intelligence testing

• Application Security

• Quality Assurance Training and Mentoring

Mission: To provide thought leadership, specialized expertise, higher quality and lower costs therefore accelerating value to help clients mitigate risk, protect revenue, and increase efficiency through the implementation of strong Quality Management (QM) initiatives.

[


What is Performance Testing

5

Detecting problems that occur only when many people are using the application at the same time.

Typical problems include:

• Poor Response Time• Resource Over-utilization• Application Instability• System Failure

#1 cause of performance issues is missed configuration items!

[


Benefits of Performance Testing

6

• Confidence your application can sustain current and future user volume, especially critical after upgrades or modifications.

• Understanding of end-user response times under load conditions to determine if applications meet Service Level Agreements you have with your customers

• Risk mitigation by means of using standard practices for performance testing

• Capacity Planning for future growth• Independent verification that your hosted

application is performing to agree-upon standards

[


Common Types of Applications

7

SAP – Web and R3 Custom Java and .Net web applications Ecommerce applications News and Media applications Other ERP Systems: Oracle, JD Edwards,

PeopleSoft, Lawson

We can support almost any application out there!

[


When to Performance Test

8

• New application implementations

• Identify performance issues not seen in functional test• Verify applications can process peak volumes• Anticipate user experience• Provision hardware• SLA verifications

• For deployed applications• Upgrade or enhancements• Anticipate user growth• Verify architectural changes

[


Performance Versus Functional Testing

9

Load testing and functional testing are complementary activities.

• Functional Testing is Broad in Scope− examining every detail of the application to ensure

correct behavior

• Load Testing is Narrow in Scope− it presumes the application functions properly, and

focuses on a few key business scenarios to investigate how it performs under load.

[


Performance Test Goals

Set well-defined Goals Acceptable transaction response times Maximum expected concurrent users Maximum expected transaction rates

Define the Scope of test Exercise all critical architecture components Determine if multiple locations to tested Determine key business processes Determine data set requirements

Determine Time Lines Determine the target critical dates Make sure all required resources are available

10

[


Defining your Business Process

11

Business Process a sequence of actions a user performs to accomplish

a certain task Examples

Enter a sales order into SAP Enter search criteria and randomly open returned

documents Enter employee time for a pay period

Criteria mission criticality frequency known or anticipated performance issues new or changed functionality

[


Pick only the Best Business Processes

12

Scripts Add Overhead but its contribution diminishes

rapidly

5% Rule “If a business process

contributes less than 5% of the load, leave it out.”

exceptions: mission critical processes new or changed functionality “sensitive” business processes

Business Process Frequency

Brow se Flights Purchase Flight

View Itinerary Update Itinerary

Cancel Itinerary View Special Offers

View Account Settings Update Account Settings

Customer Feedback Contact Us

Delete Account

The 5% Rule

[


VIP Performance Testing Cycle

13

Design

Build

Execute

Analyze

VIP’s proven testing methodology and experienced staff ensures your project identifies performance bottlenecks before they impact your Production systems

Typical Engagements are 4 to 9 Weeks including Initial Planning

Initial Plannin

g

[


Initial Plannin

g

Participants

Project Stake Holders

Project ManagerSystem ArchitectsKey SMEsPerformance

ArchitectDuration

1 to 3 Weeks

Test Effort Scope Identify Software Components Target System Architecture High Volume Business Processes and Resource

Intensive System Activities Workload Profiles Performance Test Goals

Resources Target Test System Hardware Project Personnel and Test Effort Roles Test Data Management Plan Test Tools (load injection hardware and

software)

Test Schedule Project Schedule Project Dependencies Performance Test Work Breakdown Structure

[


Design

Participants

Project ManagerBusiness SME(s)System SME(s)Performance

ArchitectPerformance

Engineer(s)

Load Test Tools Test Script IDE Load Injector Farm Protocol Licensing (Web, Winsock, Citrix, etc.)

Business Process Screen by Screen Walk Through Usage Frequency and Pacing Test User IDs Test Data

System Intensive Processes Batch Jobs Reporting Systems Interfaces/Feeds

Test Monitoring Strategy Servers/Databases/Network Integrate with Load Test Tool (Security

Permissions) Data Center/ SME System Monitoring

Duration

1 to 3 Weeks

[


16

Build Test Scripts

Record Business Processes Correlate Data Parameterized Data Pacing End User Response Time Measurements Typically 6 to 8 Scripts

Test Scenarios User Ramp Up Scenario

Frequency of Business Process Activities

User Managed Activities

Results Storage

Verify Test Readiness User Concurrency

Multi-Script Concurrency

Load Injectors

Participants

Project ManagerBusiness SME(s)System SME(s)Performance

Engineer(s)

Duration

2 to 12 Weeks

[


17

Participants

Project ManagerSystem Architect(s)Key SME(s)Performance

Engineer(s)

Execute Schedule Execution

No Users in Target System Anti-Virus Scans, Automated Backups Off Hours Scheduling

Monitor Execution Load Test Progress Load Test System Real Time Response Time Metrics Target System Utilization Under Load

General Execution Approach Small Load First To Confirm System Is Stable Reasonable User Load Ramp Up More Than One Test Execution To Confirm

GoalsDuration

1 to 6 Weeks

[


18

Participants

Project Stake Holders

Project ManagerSystem Architect

(s)Key SME(s)Performance

ArchitectPerformance

Engineer(s)

Analyze Test Goal Assessment

Response Time Performance

System Utilization

Bottleneck Identification Correlate Response Metrics with System Utilization

Metrics

Isolate Causal System/User Activity

Remediation Strategy Configuration Changes

System Changes

Hardware Changes

Test Script Changes

Load Scenario Change

Monitoring Changes

Repeat Cycle Until Goals Achieved

Duration

with execute

[


LoadRunner Architecture

19

– Controller– Mission Control– create, manage, and execute load tests

– Virtual User Generator (VuGen)– record, edit, and playback test scripts– uses C and Java

– Load Generator– executes multiple scripts to simulate load

– Analysis– review load test results– slice and dice test data, view results graphically

Main Components

[


VIP Hosted Performance Test

20

[


Internal WAN Performance Test

21

No firewall holes required!

[


Monitoring Performance Results

22

[


VIP Velocity Performance Testing

23

A software Performance Testing program where VIP provides both the services, tools, and licenses for a fixed price.

Features included in every package are: Professional services to plan project, build scripts,

execute test, and analyze results. HP LoadRunner tool and licenses. Custom virtual user script development. System monitors during testing. VIP Load generation from the Internet. Experience performance testing SAP Software.

[


Key Customer Benefits

24

Customer Benefits Affordability – Many customers have not been able to afford

performance testing because of the initial cost of purchasing LoadRunner. This program essentially allows them to “rent” LoadRunner from VIP in combination with our Expert services at an affordable price.

Fixed pricing – Engagement prices are agreed upon in advance and include all necessary labor, software licenses, and computer hardware. (T&E is still extra if required.)

Savings – Choosing a Velocity package can save customers up to 70% over the cost of purchasing their own LoadRunner license.

Experienced Performance Engineers – Use of VIP salaried staff members experienced at designing and leading performance tests in a wide variety of complex architectures and a specialty in SAP applications.

External hosted load testing – Packages include use of VIP load generation farms that can generate up to 1 Gb/sec of data load over the internet.

#1 Performance testing tool - Use of industry leading performance testing tool, LoadRunner, without the upfront purchase price. Allows customers the superior tool at a lesser cost than the competition.

[


Performance Testing Packages

25

Basic Package Standard Package Plus Package

Duration 3 weeks 4 weeks 6 weeks

LoadRunner license Included Included Included

LoadRunner hardware Included Included Included

LoadRunner performance monitors Included Included Included

1 Gb/sec internet load generation Included Included Included

Remote test administration Included Included Included

Custom Web script development Included Included Included

Experienced Performance Architect Included Included Included

Off hours test execution Included Included Included

Performance analysis Included Included Included

Improvement recommendations Included Included Included

Final performance report Included Included Included

Maximum concurrent users 250 500 500

Included Web LoadRunner Scripts 3 5 8

Test days included 3 4 6

[


Recent VIP Velocity Performance Tests

26

IHS Inc – SAP HRCatholic Health Initiatives - Lawson 9Cargill - SAP Business Objects, PeopleSoft HRStanford University - Zimbra emailFirst Data – Oracle 11iPeaceHealth – Lawson 9, CentricityGeneral Growth Properties – JD EdwardsPlato Learning – Custom Java Web

[


27

] Thank you. VIP Contact Information

Dan DeLano, VIP Practice Manager(303) 594-0961

[email protected]

Nancy Carey, VIP Sales Manager(215) 340-5324

[email protected]

asug vip performance testing 2010

Documents

real advantage

performance testing

performance testing

questions real experience

standards real experience

functional testingload

live performance

performance test goals