secrets to realistic load testing

Secrets to Realistic Load Testing

© 2015 SOASTA. All rights reserved. April 18, 2023 2CONFIDENTIAL – Not for Distribution

1. Build performance tests which will model real user behavior on your site

2. Tie business metrics (ROI) to website performance metrics and real user data

3. Correlate data analytics so you can troubleshoot bottlenecks and improve performance.

In this webinar you will learn to:

© 2015 SOASTA. All rights reserved. April 18, 2023 3CONFIDENTIAL – Not for Distribution

Presenters

Craig Combs Technical Director,

Performance Engineering

Mike OstenbergSolution Engineer

Moderator: Kathy LamProduct Marketing

© 2015 SOASTA. All rights reserved. April 18, 2023 4CONFIDENTIAL – Not for Distribution

How fast should your site be?

© 2015 SOASTA. All rights reserved. April 18, 2023 5CONFIDENTIAL – Not for Distribution

Speed costs money…

© 2015 SOASTA. All rights reserved. April 18, 2023 6CONFIDENTIAL – Not for Distribution

…and how much load should it handle?

© 2015 SOASTA. All rights reserved. April 18, 2023 7CONFIDENTIAL – Not for Distribution

Your customers will be your guide…

Survey

© 2015 SOASTA. All rights reserved. April 18, 2023 9CONFIDENTIAL – Not for Distribution

mPulse

How fast is my site?What locations?From where?Which pages?Which flows?

CloudTest

Full scale loadFrom any locationGoing through real user flowsWith real-timeanalytics

Real-Time Analytics with Real User Measurement

© 2015 SOASTA. All rights reserved. April 18, 2023 10

CONFIDENTIAL – Not for Distribution

• Tying Business Metrics to (ROI) with website performance metrics and real user data

CONFIDENTIAL – Not for Distribution © 2015  SOASTA. All rights reserved. January 13, 2015

Building performance tests that model user behavior on your site

First you need to determine the workload for the test.

How are companies doing that today?• Guessing.• Logs. • 3rd Party tools.

What if I have a new system?

© 2015 SOASTA. All rights reserved. April 18, 2023 12

CONFIDENTIAL – Not for Distribution

o What information I need?

● When is your peak second/minute/hour/day?● What is your peak volume? (active sessions, unique users,

page visits, orders, ...)● What is the median session length?● What is the distribution of user paths?● What is the distribution of devices?● What is the distribution of locations?

o Good Test Data● Search Terms● Product Distribution● Browse Distribution● Cart Size● Order Size

How to get a realistic load testFactors to consider

© 2015 SOASTA. All rights reserved. April 18, 2023 13

CONFIDENTIAL – Not for Distribution

Use real user data to model real user tests

ROI of Performance

Focus on the ROI of Performance

CONFIDENTIAL – Not for Distribution © 2015  SOASTA. All rights reserved. January 13, 2015

“What If” : Why we testPredict the future with mPulse!

CONFIDENTIAL – Not for Distribution © 2015  SOASTA. All rights reserved. January 13, 2015

Sunburst charts shows the most common session paths of real users

CONFIDENTIAL – Not for Distribution © 2015  SOASTA. All rights reserved. January 13, 2015

Data Science Workbench Analyze mPulse beacons to build the RIGHT performance and load tests!

© 2015 SOASTA. All rights reserved. April 18, 2023 19

CONFIDENTIAL – Not for Distribution

Now you are ready to test

© 2015 SOASTA. All rights reserved. April 18, 2023 20

CONFIDENTIAL – Not for Distribution

Test how you want, when you want, where you want

© 2015 SOASTA. All rights reserved. April 18, 2023 21

CONFIDENTIAL – Not for Distribution

1. Let your users help you determine your performance goals

2. Tie business metrics, (conversion rates, length of engagement, etc) to calculate costs of performance vs revenue gain

3. Use data analytics to review site performance data to isolate bottlenecks, which can guide your performance investments

Summary

© 2015 SOASTA. All rights reserved. April 18, 2023 22

CONFIDENTIAL – Not for Distribution

GET STARTED RIGHT AWAY

© 2015 SOASTA. All rights reserved. April 18, 2023 23

CONFIDENTIAL – Not for Distribution

Questions?

Mike OstenbergDirector Solutions Engineering

Email:mostenberg@soasta.com

Craig CombsTechnical Director, PE

Email: ccombs@soasta.com

Twitter: CCdiddy