mobile testing checklist
DESCRIPTION
Mobile testing is different. We cannot confine app testing to just the functionality of the app itself. We have a new set of test conditions we have to consider just because the app is running on a mobile device. This presentation discusses high-level mobile specific test conditions and how to choose the appropriate ones for your mobile app.TRANSCRIPT
© Utopia Solutions
Mobile Testing Checklist
Lee Barnes, CTO Utopia Solutions
© Utopia Solutions 2
Mobile testing is…
…different
www.motivationalmemo.com
© Utopia Solutions 3
iOS 8iOS 7Earlier
Multiple OS / Fragmentation
4.44.34.24.14.03 - 4.042.3.3 - 2.3.72.2 & earlier
Source: OpenSignal Android Fragmentation Report August 2014 Source: Mixpanel Trends iOS Adoption – Sept 23, 2014
© Utopia Solutions 4
Device Diversity
© Utopia Solutions 5
Carrier Modifications
© Utopia Solutions 6
App
Functionality
Mobile Specific Test Conditions Mobile Testing
Iceberg
Diversity Increases Test Burden
© Utopia Solutions 7
Mobile Specific Checklist Test Conditions
Installation
Interrupt
Network
Device Integration
Performance
© Utopia Solutions 8
Mobile Testing Checklist
Interrupt Conditions
Incoming / Outgoing Calls
Popup Alerts (Calendar, Alarm, SMS, etc.)
Power Cycle
Extended Background
© Utopia Solutions 9
Mobile Testing Checklist
Installation Conditions
Install
Uninstall
Reinstall
Update
© Utopia Solutions 10
Mobile Testing Checklist
Network Conditions
Network Type (Mobile variations and WiFi)
Network Quality
Network Loss
Network Transition
© Utopia Solutions 11
Mobile Testing Checklist
Performance Conditions
Speed / Responsiveness
CPU and Memory Usage
Battery Drain
On-Device / Memory Card Storage
© Utopia Solutions 12
Mobile Testing Checklist
Device Conditions
Location / GPS
Video / Still Camera
Screen Size, Resolution, Orientation
Gestures & Accelerometer
© Utopia Solutions 13
Mobile Test Case Selection
App Type
App Usage
App / Device Integration
© Utopia Solutions 14
Device Configuration Selection
App Functionality & Technology
User Profile
Business Objectives
• Deployment platforms & versions
• App interaction with device • Integrated systems
• Prevalent Devices • Preferred Browser • Concurrent usage /
load profile
• Application value to the business
• Risk of application failure
© Utopia Solutions 15
Mobile Testing
© Utopia Solutions 16
Mobile Test Case Matrix
© Utopia Solutions 17
Test Automation
Execute test cases across a set of diverse devices
© Utopia Solutions 18
Questions…
…. and Answers!
Direct future questions to: Lee Barnes Founder and CTO Utopia Solutions, Inc. Email: [email protected] Twitter: twitter.com/USI_LeeBarnes LinkedIn: linkedin.com/in/leebarnes Blog: www.RaiseYourMQ.com