Download - CMG imPACt2016 - Mobile performance testing - Vendor training - Federico Toledo, Sofia Palamarchuk
• Co-founder and CEO US at Abstracta (www.abstracta.us)
• PhD and author
• +10 years experience in performance testing
• +80 projects worldwide
Who we are
• Introduction• Performance, testing, simulation
• Server side• Load testing• Monitoring
• Client side• Device performance with Monkop
• Continuous Integration
• Hands-on with Monkop
Agenda
• Introduction• Performance, testing, simulation
• Server side• Load testing• Monitoring
• Client side• Device performance with Monkop
• Continuous Integration
• Hands-on with Monkop
Agenda
• Introduction• Performance, testing, simulation
• Server side• Load testing• Monitoring
• Client side• Device performance with Monkop
• Continuous Integration
• Hands-on with Monkop
Agenda
• Introduction• Performance, testing, simulation
• Server side• Load testing• Monitoring
• Client side• Device performance with Monkop
• Continuous Integration
• Hands-on with Monkop
Agenda
• Load simulation tools
• JMeter (jmeter.apache.org)
• Taurus (gettaurus.org)
• BlazeMeter (blazemeter.com)
• Gatling (gatling.io)
Technologies
BlazeMeter• Increase JMeter’s potential to thousands
of users.• Real-time Reporting and Comprehensive
Analytics
BlazeMeter• Third party integration (APM & CI tools)• Simulate Production Network Conditions• Run tests from multiple geographic
locations
• Profilers and similar (JVisualVM, JProfiler, dotTrace)
• Operating system (NMON, perfmon, Netdata)
• APMs (AppDynamics, NewRelic, Dynatrace)
Monitoring
• Introduction• Performance, testing, simulation
• Server side• Load testing• Monitoring
• Client side• Device performance with Monkop
• Continuous Integration
• Hands-on with Monkop
Agenda
• Introduction• Performance, testing, simulation
• Server side• Load testing• Monitoring
• Client side• Device performance with Monkop
• Continuous Integration
• Hands-on with Monkop
Agenda
PageSpeed Insights
Performance and usability
Information to optimize client-side performance
Based on “best-practices”
Mobile Web Apps• PageSpeed• Yslow• Monkeytest.it• APMs
Native Apps• Google Cloud Test Lab / Testdroid /
Perfecto• iOS: Instruments / XCTest• APMs (Libraries)• Monkop
Technologies
https://results.monkop.com/d8af6f27-7b0e-4573-b806-8303946269e3/report/report/index.html
Test app behavior on multiple devices
• Cloud Lab: Automatic device selection of the most popular devices, Android OS versions and screen sizes.
• Compatibility testing: Install / Run / Uninstall
• Crash testing: ANR + crashes
• Performance analysis on each device and native development best practices
Detailed performance information
• Know how the app behaves in terms of performance and resource usage.
• Detect bad programming practices and obsolete libraries.
• Top SQLs, startup times, network, memory, CPU, GC, GPU.
• Profiling - coming soon.
1- Robo-Test + Data
• No scripts – no setup!• Input data can be
used to “unlock” screens
• Online (Cloud) or Desktop (Monkop Solo)
2- Test Automation
• Open source languages supported – instrumentation like Robotium, Espresso, UI Automator, etc.
• Any other language can be mounted on Monkop Server.
3- Command Line
• CLI to execute from any machine
• No need to read documentation or study how to use the API
4- Continuous Integration
• Automatic Smoke Tests before sending a new version to QA
• Automatically label each build with the results (i.e. Github)
• Increase coverage through test automation
• Introduction• Performance, testing, simulation
• Server side• Load testing• Monitoring
• Client side• Device performance with Monkop
• Continuous Integration
• Hands-on with Monkop
Agenda
• Introduction• Performance, testing, simulation
• Server side• Load testing• Monitoring
• Client side• Device performance with Monkop
• Continuous Integration
• Hands-on with Monkop
Agenda
• Introduction• Performance, testing, simulation
• Server side• Load testing• Monitoring
• Client side• Device performance with Monkop
• Continuous Integration
• Hands-on with Monkop and Taurus
Agenda
• Introduction• Performance, testing, simulation
• Server side• Load testing• Monitoring
• Client side• Device performance with Monkop
• Continuous Integration
• Hands-on with Monkop and Taurus
Agenda
Hands-on: Monkop and Taurus
• Requirements: • Curl• Python 2.7
• Run Monkop CLI• Analyze the report
• Run Taurus• Install it• Prepare file quick_test.yml• Run the test (the first time takes a while)• Analyze results in BlazeMeter
Instructions and help:www.monkop.com/cmgimpact.html
If you like it
Certification in Performance Testing with JMeter and BlazeMeter
• Online course (one month)• www.abstracta.us/training
Cupon code: 25% OFF this month IMPACT2016
http://bit.do/librodetesting
PhD. Federico Toledo@fltoledo
Sofia Palamarchuk@sopalamarchuk
Silicon Valley office425 Broadway Street Redwood City, CA
HeadquartersJose Ellauri 1126 Montevideo, Uruguay
www.abstracta.us