seven steps to remove barriers and accelerate mobile testing
TRANSCRIPT
Chris Karnacki
Senior Solutions Consultant
Keynote
Seven Steps to Remove Barriers and Accelerate Mobile Testing
May 26, 2015
Mobile testing is fundamentally different!
© 2015 Keynote, LLC
DESIGN-DRIVEN
DEVELOPMENT
CONTINUOUS
DELIVERY
EXPERIENCE-
DRIVEN
ANALYTICS
IDEA
THE PROCESS IS DIFFERENT
THE LIFECYCLE REDEFINED
Designers : 1Developers : 2-4
Quality : 1-2Mobile architects : 1
THE TEAM SIZE IS DIFFERENT
Mobile testing is fundamentally different!
© 2015 Keynote, LLC
The release frequency is different Release velocity has moved beyond enterprise control.
OS’s (e.g., iOS, Android, Windows)
# Fo
rm f
acto
rs /
dev
ices
The NxN testing matrix is different This isn’t your grandmas’ Windows + IE matrix anymore.
Mobile testing is fundamentally different!
© 2015 Keynote, LLC
User expectations are different User expectations are at an all time high. Tolerance for a poor UX is at an all time low.
Quality is differentWho owns quality? Dev or QA? Mobile teams have a different structure.
for any digital interaction to load1
3SECONDS OF TOLERANCE
The user is king
Skills, collaboration, consistency
© 2015 Keynote, LLC
“Why can’t you reproduce this error, Number One?”
Just get me on the road to recovery, please.
© 2015 Keynote, LLC
The seven step program to removing barriers and speeding up mobile testing
© 2015 Keynote, LLC
Think like a mobile app user
© 2015 Keynote, LLC
1. What do I need to do without any reading
anything…is it clear what I need to do?
2. What’s the key user journey’s?
3. What doesn’t work? What are the simple ways to
work around the key user journey
• Fuzz testing
• Negative testing
• Exploratory testing
Real device testing or emulators?
© 2015 Keynote, LLC
iOS emulators
Android emulators
device lab by Jeremy Keith on Flickr
Smoke tests…who needs them? EVERYONE
© 2015 Keynote, LLC
1. app launch2. login3. key first common action4. logout
Get your developers involved!
© 2015 Keynote, LLC
Automate, automate, automate ... but start simple!
© 2015 Keynote, LLC
Who needs continuous integration? EVERYONE
© 2015 Keynote, LLC
Manual and Automation
Functional Testing
Improves coverage / quality with functional testing for mobile apps and websites
Robust and resilient automation (object level support) to shorten release cycles
Largest cloud library of real iOS and Android devices; zero device management
Remote access for geographically distributed teams
Day 1 support for new OS releases
Functional testing powered by the cloud
© 2015 Keynote, LLC
Questions?
Thank you
© 2015 Keynote, LLC