how to prevent app failures with real user conditions
TRANSCRIPT
![Page 1: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/1.jpg)
Prevent App FailuresTest Real User Conditions
![Page 2: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/2.jpg)
2
Sveta Kostinsky Dir. Field Engineering
![Page 3: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/3.jpg)
Meet your Users!
05/03/2023 3© 2015,Perfecto Mobile Ltd. All Rights Reserved.
Georgia PeterSara SamRoss
![Page 4: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/4.jpg)
Quality reality
![Page 5: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/5.jpg)
Mobile Calendar 2016
05/03/2023 5© 2016, Perfecto Mobile Ltd. All Rights Reserved.
![Page 6: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/6.jpg)
Mobile application release frequency
• Most successful apps release 1-4 updates a month
• Release should balance between bug fixes and feature updates
• Updates is a great marketing tool for developers to leverage
• Developers can speak with their user base via release notes or comment in the reviews
05/03/2023 6© 2016, Perfecto Mobile Ltd. All Rights Reserved.
201736 per year
App releases per year
*The IDC predicts that by 2017, most app releases will occur 36 times per year
![Page 7: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/7.jpg)
Problem
05/03/2023 7© 2015,Perfecto Mobile Ltd. All Rights Reserved.
The Digital Reality
Users expect apps to work in the mobile moment
(regardless of conditions)
Failure to satisfy is costly
![Page 8: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/8.jpg)
Problem
05/03/2023 8© 2015,Perfecto Mobile Ltd. All Rights Reserved.
The Mobile ExperienceQuality Challenge
1) Build common user environment condition profiles into test suites
2) Assemble multiple solutions to execute tests across profiles
3) Integrate user condition testing within Continuous integration pipelines
4) Analyze app performance blind spots
![Page 9: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/9.jpg)
True user centric testing
Optimize your LAB environment, LAB configuration and the choice of user flows to reflect your users.
05/03/2023 9© 2016, Perfecto Mobile Ltd. All Rights Reserved.
![Page 10: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/10.jpg)
05/03/2023 10© 2015,Perfecto Mobile Ltd. All Rights Reserved.
Georgia PeterSara SamRoss
![Page 11: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/11.jpg)
05/03/2023 11© 2016, Perfecto Mobile Ltd. All Rights Reserved.
End user conditions in your lab
Name: SaraLocation: LondonDevice: iPhone 6, iOS 9.2Carrier: BTNetwork condition: 3GBackground apps: Instagram, Facebook, Uber
Align coverage planning to business priorities
Automate lab configuration to end user conditions
Multiple devicesMobile | Tablet | Desktop
End user conditions
![Page 12: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/12.jpg)
Quality in the digital era needs to align to the business
12
© 2015, Perfecto Mobile Ltd. All Rights Reserved.
Marketing / Business Business-Engineering alignment Automated lab configuration Communicate Risk in business terms
Name: SaraLocation: LondonAge: 25Device: NewSensitivity to UX: HighBehavior: Fashion magazine designer
Engineering
Name: SaraLocation: LondonAge: 25Device: NewSensitivity to UX: HighBehavior: Fashion magazine designer
Name: SaraLocation: LondonDevice: iPhone6, iOS 9.2Carrier: BTNetwork: 3GBackground Apps: Instagram, Facebook
![Page 13: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/13.jpg)
05/03/2023 13© 2016, Perfecto Mobile Ltd. All Rights Reserved.
Name: SaraLocation: LondonDevice: iPhone6, iOS 9.2Carrier: BTNetwork: 3GBackground Apps: Instagram
Persona dimension in the coverage matrix
![Page 14: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/14.jpg)
Real user condition - Network
• vs. corporate firewall
• LTE to WiFi seamless transition
• WiFi assist on iOS9
• Offline mode testing
14
![Page 15: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/15.jpg)
Real user condition - Network
• Weak network signal – will I be charged twice??
• Changing network conditions flows – 3G/LTE
• Have to test the end to end flow on IPV6
• Always helps to test on real carrier network – SIP
• Apple Network link conditioner vs. external emulation TCP layer acknowledgements timing
15
![Page 16: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/16.jpg)
Real user condition - Working with 3rd party applications
• Sharing the device Camera application
• Notifications, incoming calls, incoming text messages
• Posting to third party application
• Performing sign in via a 3rd party application
• Context switching between the apps
16
![Page 17: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/17.jpg)
Real user condition - Memory and CPU
• iPhone photos application
• Low memory conditions on the device
• Hybrid apps and low memory
• Thermal throttling of CPU – LTE connection
17
![Page 18: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/18.jpg)
Real user condition - Rotation state and language
• Testing different orientation
• The need for visual analysis
05/03/2023 18© 2016, Perfecto Mobile Ltd. All Rights Reserved.
![Page 19: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/19.jpg)
User Centric Quality - Lab with Real end user environment conditions
Simple Functional Testing Is Not Enough
![Page 20: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/20.jpg)
Perfecto Wind Tunnel - Lab Environment
Easily bring your end user experience into the lab
Offer a test environment that expands coverage to real world user conditions
So that,1. User experience blind spots are exposed2. Mobile-user expectations are met3. Business outcomes are assured
05/03/2023 21© 2015,Perfecto Mobile Ltd. All Rights Reserved.
![Page 21: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/21.jpg)
Demo time
05/03/2023 22© 2016, Perfecto Mobile Ltd. All Rights Reserved.
![Page 22: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/22.jpg)
Lab Configuration
Is your LAB up-to-date?No, really up-to-date?
Set up an agile lab, responsive to adoption trends.
05/03/2023 25© 2016, Perfecto Mobile Ltd. All Rights Reserved.
![Page 23: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/23.jpg)
Optimize your lab
05/03/2023 26© 2016, Perfecto Mobile Ltd. All Rights Reserved.
![Page 24: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/24.jpg)
User flow
BI and flow analysis as part of Persona
27
Where should I spend most of my time?
![Page 25: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/25.jpg)
05/03/2023 28© 2016, Perfecto Mobile Ltd. All Rights Reserved.
![Page 26: How to Prevent App Failures with Real User Conditions](https://reader035.vdocuments.us/reader035/viewer/2022062503/587558c01a28ab00528b5cc1/html5/thumbnails/26.jpg)
Next Webinar June 30: Why Apps Succeed
• Panel Discussion of New Survey Results
Register today:http://info.perfectomobile.com/Why-Apps-Succeed-Registration.html
05/03/2023 29© 2016, Perfecto Mobile Ltd. All Rights Reserved.