2006 oct web seminar powerpoint

8/12/2019 2006 Oct Web Seminar Powerpoint

1/12

Performance Testing

Tips and Techniques

Understanding Operational Profiles

Dale L Perry

Software Quality Engineering


2/12

22005-2006 Collard & Company/SQE V2.2

Performance Profiles

One of the key activities in performance

testing is to decide what type of load orloads to place on the system/application

There are many variations of performancetesting that we can select from so we first

have to determine what is needed


3/12


Types Of Performance Testing

The three most common types of software

performance testing include: Testing which is driven by what we want to

measure

Testing which is based on the source or type

of the load

Testing to stress the system or find its limits


4/12


5/12


Load (Operational) Profile

To better simulate the real world, not only

should the load size be estimated, but alsoa profile of the users/activities that make up

the load needs to be created


6/12


Test Sample Sizes

Most factors which we want to measure, such as

response time, vary based on many factors; bothknown and unknown This means we cannot measure something once but

must sample it several times in order to compute ameaningful average

How big does the sample need to be? This is a roughrule of thumb for the relationship between sample sizeand accuracy

Sample AccuracySize (roughly)

30 50%100 25%200 10%

1,000 3%


7/12112005-2006 Collard & Company/SQE V2.2

When To SampleSampling Errors7 9

Eastern

Central

Mountain

Pacific



Number And Types Of Users

The mix of users(events) may vary by time

period Special events can alter the mix

Browsers

Buyers


9/12



Think Times

The time it takes a client (or virtual client) to

respond to an application may have asignificant impact on the number of clientsan application can support This is a key aspect of concurrency



Background Load (Noise)

What additional activities need to be

considered to accurately reflect theperformance degradation caused by

network and other application loads,

background noise?



Summary

A successful software performance test

plan starts with knowing what it is you wantto accomplish

What types of tests do you want?

What loads and mixes are are needed for

these tests

Operational profile

2006 oct web seminar powerpoint

Documents