web performance testing

CSC Proprietary and Confidential 04/08/23 15:33 PPT 2007_Planning_FMT 1

Presenter’s Name

Presenter’s Title

Date


Agenda

• The Impact of Web Performance

• Challenges with Traditional Testing

• Trusted Cloud Web Performance Testing

• The Web Performance Testing Model

• A Case Study and Analytic Dashboard

• The CSC Accreditation

• Next Steps


Reliability Matters

“ 9 out of 10 website visitors switch to a competitor's website if a company's website fails to load “

- Survey by 1&12

“ 28% of online shoppers will not wait longer than four seconds for a web page to load before leaving “

- Akamai and Jupiter Research

“90% of all web services are not load-tested”

- InformationWeek


Impact of Performance

Brand Image

Revenue

Customer Loyalty

Customer Experience


Challenges with Traditional Testing

• Inability to quickly isolate issues across the infrastructure

– Monitoring application, network and servers

– Aggregation/correlation technology to analyze and synthesize test data

Show only Traditional Testing

• High Cost to Simulate Real World Traffic and Users

– Availability and provisioning of needed hardware

– Software licenses for high volume of Virtual Users

– Staff time required to prepare environment and implement testing


Trusted Cloud Web Performance Testing

• Effective

– Real Time Monitoring of App-Environment-Platform

– Sophisticated Analytics

– Quickly pinpoint issues and fault points

• Affordable

– Load and Performance Testing

– Leveraging the Cloud On Pay-Per-Use Model

• Scalable

– Simulating Real World Users and Web Traffic

– 10,000+ simultaneous users, from multiple servers

– Loads generated from one or multiple global regions

• Agile

– Rapid deployment and execution

– Speed total time to resolution


CSC Web Application Testing Delivery

• Define Test Requirements Based on Business Need– Kick-off meeting

• Test Development and Setup– Performance Engineer creates user scenario and test plans

– Load, stress, performance testing parameters, ramp speed, duration

• The CloudTestTM

– Provision the required load servers/locations

– CloudTest TM (SSH or agent) monitors all aspects of networks, system and applications

– CloudTest TM is pointed at target application and testing begins

• Results and Analytics– CloudTest TM real time dashboards begin presenting live test

results and analysis

– Test engineers review with customer live data as test is running

– Deliver a full written report, including screen shots and tuning recommendations


Define Objectives and Test Requirements

Determine Limits

Measure User Experience

Test Specific Silos

Verify Redundancy

Exceed Break Points

Plan For The Future

Reliability Over Time

Test Objective

Load Test

Browser Performance Test

Targeting Infrastructure TestFailover Test

Stress Test

Capacity Test

Soak Test

Web Performance Test


Test Development and CloudTest TM

• AJAX-based, Modern Test Application

• The CloudTest TM Global Platform

• Data-Driven, Real-Time Test Analytics

• Test Engineers, Provision and Execute


Performance Assessment Analytics


Trusted Cloud Web Performance Testing Partnership

SOASTA and the SOASTA Logo are trademarks of SOASTA, INC.


CSC Global Testing Practice

• Full lifecycle managed test services

• Industry consulting to drive transformation

• Testing Center of Excellence (CoE) integrating best-of-breed test processes

• Testing solution accelerators – Technology– Domain– Process

• Access to large pool of certified resources

• Lifecycle Automation Solutions– Test automation frameworks– Tools labs and alliance

partnerships

• 6000+ testing personnel

• Optimal mix of domain, testing, tool and management expertise

• Global footprint –

– Multiple low cost centers

– World Sourcing, follow-the-sun model

– ITAR facilities

• Flexible engagement models

– co-ownership,

– managed testing services

– Testing as a Service (TaaS)

• Indigenously developed flexible yet rigorous process models

• Ensured independence through a strong governance structure

• SLA-driven Risk-Reward model

• Cost leveraging right-shoring and reusable assets

• Reduced TCO and cycle time

Comprehensive Capability

GlobalizedService Delivery

Predictable GainsThrough DeliveryExcellence


Requirements Collection

System Study

Test Strategy Design

Test Environmental Setup

Deployment of Monitors

Traversal Document

Scripting

Test RunAnalysis & Interim Report Implementation of

Recommendations

Final Comprehensive Report

Project Closure

Baseline Test RunEnhancement Test RunDiagnostic Test Run

Performance Testing Lifecycle



Case Study: Spotlight

• Millions of eFilers each TAX year

• Several Performance issues in the Past

• Internal Test Lab cost $4M (4K Test)– Test Tools: Silk-Keynote-Wily

• SOASTA CloudTest TM Live Production

– Tested over (33) Days

– Slowly Ramping up User Traffic

– Ramp-Monitor-Detect-Fix-Ramp

– Peak, Reached 300,000 concurrent users

– Peak, provisioned 2,200 Cloud server cores

– Detected (27) “critical” performance issues

• Testing CloudTest TM achieved (75X) results



The Dashboard allows easy-to-use, real-time analytics based on testing implementation.

Real-Time Test Analytics


Case Study

“ Most confidence we have had in an Intuit system in production… Ever! Thanks SOASTA! ”

Dan BartowManager of Performance

Engineering

TurboTax



CSC Accreditation: Performance Matters

• Validate performance level of a web application/web site

– Average response time most accurately overall end to end performance metric

– Real time performance feedback during testing to highlight areas of improvement

– Accreditation report defining site performance based on metrics gathered during test

• Accreditation Features

– 25 Hours of Performance Testing

– 10,000 Virtual Users

– 100 Hours of Build-Test-Analysis Time

– Accreditation Report

– Review of Findings On a Debrief Call


Next Steps

Trusted Cloud

Web Performance Testing

Schedule a Demonstration of Real Time Analytics

Schedule a Kick Off Meeting To Understand needs and requirements

www.csc.com/cloud