how to test performance of your mobile apps in 20 minutes

BlazeMeter.com | 175 Varick Street NY, NY | 1-855-455-2285 | [email protected]

Load Testing Mobile Sites and Apps Made Easy(using open source compatible and

cloud based solutions)

mailto:[email protected]



BlazeMeterOphir Prusak Customer Satisfaction & Education




Today’s Agenda

• The Current State of Affairs

• Challenges and the Importance of a Fast Mobile Experience

• Mobile Testing Solution Walkthrough

• Q&A




Current State of Affairs





Internet Searches

mobile applicationdevelopment

mobile application testing

mobile performance testing

mobile application performance testing


mobile performance testing


Internet Searches




Mobile Challenges

Desktop Mobile

Client “Standard” Browser Multitude of clients

Technology HTML HTML / Native

Bandwidth Fast (1-20 Mb/s) Slow (0.1 Mb/s and up)

Latency Small (less than 100ms) Large (100-1000ms)

Visual Feedback Immediate After data has loaded*




Network Challenges

Latency effect on page load times

Source: http://www.igvita.com/2012/07/19/latency-the-new-web-performance-bottleneck/



http://www.igvita.com/2012/07/19/latency-the-new-web-performance-bottleneck/

http://www.igvita.com/2012/07/19/latency-the-new-web-performance-bottleneck/


Development Life Cycle




Performance Testing Solution Walkthrough

Load Testing Steps• Record the mobile user scenario• Configure test parameters• Run load test• Analyze the results




Recording a Mobile User

Simulation Techniques• Browser Spoofing- Over-ride user-agent string- Only applicable for mobile websites- Does not simulate mobile hardware or functionality

• Proxy Recording- Works with almost all mobile apps - Requires setting up mobile device to use a proxy




Setup the Proxy




Get Your Local IP

Local IP address on a Mac




Point Device to the Proxy

Defining proxy settings on an iPhone




Run the App

Real usage of a mobile app (CNN iPhone app)




View Requests in JMeterAll of the requests made by the app.

Request Headers




Full Recording of All Data

DifferentUser Agent




Load Testing Steps

• Record the mobile user scenario• Configure the test parameters• Run test load test• Analyze the results




Define Test Parameters

- Number of Users - Number of Servers- Test Duration- Ramp Up Time- Load Server Geo Location- Custom DNS- Private IPs- Aggregation of Multiple Tests

Run in Parallel




Mobile Network Emulation

Define bandwidth and latency for each simulated user




Developer Integrations- Plug-ins for integration into agile / continuous integration tools- Full REST API for custom integration- APM integration for detailed application monitoring- Detailed error reporting- Fully automated spin up / down of dedicated servers- 100% compatible with open source scripting (JMeter)




Load Testing Steps

• Record the mobile user scenario• Configure the test parameters• Run test load test• Analyze the results




Detailed Reporting- Performance Testing KPIs- Waterfall Report with Detailed Timings- Error Report- Real Browser Timings with Selenium- Server Monitoring- Front End Page Speed Recommendations- Application Performance Monitoring- JMeter Logs




Detailed ReportingLoad Results APM - New Relic Real Browser - Selenium

Waterfall Front End Recommendations Errors

