accelerate web and mobile testing for continuous integration and delivery
TRANSCRIPT
© 2014 SOASTA. All rights reserved. 1
Accelerating Application Delivery with Continuous Testing
Ensuring quality through the continuous delivery lifecycle
© 2014 SOASTA. All rights reserved. 2
Brad JohnsonVice President Product Marketing
© 2014 SOASTA. All rights reserved. 3
In This Webinar
Agenda: • The need for “Continuous”• CI with mobile and performance testing• SOASTA CloudTest and TouchTest with Jenkins (demo)
Questions: Submit in chat box during event
© 2014 SOASTA. All rights reserved. 4
Addressing The New Generation of Demands
User Experience
Unpredictability Continuous
Mobile
100’s to millionsLocal to global
100% availability
Agile developmentContinuous delivery
DevOps principles
FastSeamless
Disposable
Online everythingMobile commerce
Legacy modernization
© 2014 SOASTA. All rights reserved. 5
Laying the FoundationA factory streamlines for quality and speed
Does it work as designed?
Does it perform under
extreme circumstance
s?
Approve materials
Real Drivers
What happens in actual conditions?
Assembly Line
© 2014 SOASTA. All rights reserved. 6
Laying the FoundationCD streamlines for continuous quality
Functional validation
Performance,reliability,scalability tests
Real Users
Build
What happens in actual conditions?
Unit-tested code
© 2014 SOASTA. All rights reserved. 7
CI Offers Speed of Delivery
o Small Batch Sizes
o Comprehensive Version Control
o Simple Branch Strategies
o Automation
o Continuous Feedback
o Emphasis on working builds
o Consistent environments
o Developer – Tester Collaboration
What’s not to like?
© 2014 SOASTA. All rights reserved. 8CONFIDENTIAL – Not for Distribution
Poll Question
© 2014 SOASTA. All rights reserved. 9
Testing has ALWAYS been the Bottleneck
© 2014 SOASTA. All rights reserved. 10
CONFIDENTIAL – Not for Distribution
Continuous Testing Distributes EffortAutomation Shrinks Time
Ut
Unit Testing
Pe
Performance Testing
Fu
Functional Testing
Development TestingOperation
s
TIME
Traditional Linear Approach
© 2014 SOASTA. All rights reserved. 11
CONFIDENTIAL – Not for Distribution
Continuous Testing Distributes EffortAutomation Shrinks Time
Ut
Unit Testing
Pe
Performance Testing
Fu
Functional Testing
Development TestingOperation
s
TIME
TestDev Ops
Traditional Linear Approach
Continuous Testing Approach
© 2014 SOASTA. All rights reserved. 12
What’s Been Missing?
Mobile Test Automation
Performance Testing
Real TestDevices
Solid Integration
© 2014 SOASTA. All rights reserved. 13
Private Device Cloud All-inclusive Mobile Testing Labs
o Fully managed private device cloud installed behind the firewall
o Real-time device inventory, status and availability
o Online access for all your teams
o 24x7, secure, remote access to devices
o Mobile functional test automation software
o Remotely access to selected mobile device and any mobile app
• Use devices for manual testing and monitoring
• Remote screen-share devices for collaboration on design or issues
© 2014 SOASTA. All rights reserved. 14
Public Device Clouds
o Dedicated Public Device Cloud
o Access to the latest market leading devices (iOS/Android)
o Automatic installation, maintenance and upgrade
o Hosted devices in a secure data center
o Stock devices, not jail broken/rooted
o Seamless integration with TouchTest and CI environments
o API available to install apps, reboot/wake-up devices, launch tests
Dedicated Remote Access
Perfect for 24x7 Automated Mobile Regression Testing
© 2014 SOASTA. All rights reserved. 15
s
Memory leaks
Test Scale
Sta
ge
/ Te
am
Dev & Test
Release& Deploy
Network& Ops
CDN file placement
Load Balancer configuration
Network bandwidth
Network configuration
DNS routing
Inadequate server resources
Default configuration settings
Unbalanced web serversAuto-scaling failures
Latency between systems
Slow third-party plug-ins
Garbage collection
Database thread counts
Inefficient database queriesSlow pages
Conflict with other apps
Test Lab Staging Production (100% +++)
Search technology limits
Method-level tuning
Max sockets exceeded
Firewall max capacity
Global latency variance
Security bottlenecks
Load Testing at All StagesPerformance validation from development to production
Continuous tuning for full-scale…and well beyond
© 2014 SOASTA. All rights reserved. 16
Continuous QualityMuch more than unit testing
Use real user data toiterate dev & test plans
Run iterative load tests via Jenkins
Daily (or more frequent) updates keep teams quality focused
Embedded failure details & bottleneck data isolate issues
Manage to a performance
baseline
Mobile? Run functional automation on real devices for functional & performance validation
Spin up suitable, consistent test environments in the
cloud or the lab
I JUST MADE A CODE CHANGE
Jenkins runs any unit tests as usual
© 2014 SOASTA. All rights reserved. 17
Joe RobertsSr. Solutions Engineer
© 2014 SOASTA. All rights reserved. 18
SOASTA SolutionsQuality Across the Software Application Lifecycle
Expertise
Thanks
Contact SOASTA:www.soasta.com/cloudtest/
Follow us:
twitter.com/cloudtestfacebook.com/cloudtest
RESOURCES
Next Webinar: November 5, 2014“How to Measure the Business Impact of Web Performance”
Register: Webinars future and past:
http://www.soasta.com/knowledge-center/webinars/
Want to evaluate any SOASTA product or service?- email [email protected]
- You’ll hear from us tomorrow (maybe today)
www.SOASTA.com