karen n. johnson - mobile testing keynote delivered at test istanbul 2013
TRANSCRIPT
![Page 1: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/1.jpg)
Mobile: New Tes-ng Techniques for Our One Hand, One Eye Users Test Istanbul 2013 Karen N. Johnson
![Page 2: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/2.jpg)
“You have part of my aLen-on, you have the minimum amount.”
From the movie, The Social Network
![Page 3: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/3.jpg)
Mul-ple devices It is not uncommon to see people using mul-ple devices at one -me or to be using both a mobile phone and a laptop computer at the same -me. Each device serves a purpose. And each purpose may be beLer served by one device than another. We have to consider usage from the user perspec-ve. Users are not always on the move but may s-ll only have one hand and one eye on the applica-on they are using. Our users are becoming increasingly distracted.
![Page 4: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/4.jpg)
My tes-ng background with mobile.
![Page 5: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/5.jpg)
DIFFERENT FROM THE DESKTOP How mobile is
![Page 6: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/6.jpg)
Language
• Shake • Bump • Text • Jailbroken • Gesture • Media queries • Responsive web design • Near Field Communica-on • Triangula-on • Hybrid apps • Viewport • BYOD
![Page 7: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/7.jpg)
Loca-on
• Loca-on awareness • Connec-vity: with,
without and intermiLent • Wi-‐Fi connec-vity • 3G, 4G • Moving and traveling
around
![Page 8: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/8.jpg)
Interrup-ons
• Incoming calls • Voicemail • Incoming text messages • App no-fica-ons
“Look under that UI, and under that client, there’s a whole so_ware stack running. While your applica-on runs, the phone is s-ll talking to the network, working out where you are, maybe receiving calls, texts, Facebook and TwiLer updates. There are a lot of interac-ons going on that you don’t see.” Mobile Tes-ng – That’s Just A Smaller Screen, Right? Stephen Janaway in The Tes-ng Planet
![Page 9: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/9.jpg)
Physical
• Mobile phones get dropped in water. • Display screens get cracked. • BaLeries run low and die. • Devices get frozen and exposed to high heat, sun and other elements outdoors. • SD cards get filled. SIM cards get removed.
When we use devices inside a test lab are we simula-ng realis-c condi-ons?
![Page 10: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/10.jpg)
Social
• Mobile devices introduce an aspect of social connec-on in ways that the desktop did not.
• Mobile devices are more personal than our desktops and laptops.
• Mobile devices both bring us closer and at -me set us apart.
![Page 11: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/11.jpg)
Financial
• Mobile devices introduce financial aspects, peer pressure of owning upscale devices.
• There is a social aspect to owning highly-‐powered devices and to keeping up with the latest and greatest of what is available.
![Page 12: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/12.jpg)
Situa-onal
• Users may be facing challenging condi-ons when using their mobile devices.
• Depending on what you are tes-ng, the user’s physical and situa-onal challenges may be a factor.
• If your applica-on is forcing an update during a -me a user Is using their device for an urgent need, your app may cause disrup-on and frustra-on.
![Page 13: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/13.jpg)
NEW WAYS OF THINKING How mobile requires
![Page 14: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/14.jpg)
Think User Naviga-on
• Mobile users are unlikely to use similar paLerns of behavior as on their desktop computers..
• We need to understand how users are using their devices and how they are using the mobile apps and mobile websites we are tes-ng.
![Page 15: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/15.jpg)
Think Globally
Needing to test an applica-on or mobile website with global usage introduces challenges that are unique and not easily solved. For example, gaining access to devices, carriers may not be possible. For example how would you test mul--‐lingual input with different character sets?
![Page 16: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/16.jpg)
Think Accessibility With an array of screen resolu-ons, can our users access what is needed on mobile devices? Has our design taken a mix of screen resolu-ons into considera-on?
![Page 17: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/17.jpg)
Think New User Experience
• Mobile apps o_en implement different user controls and use access than we’ve experienced before.
• We may need to test with gestures and touch.
• We may need to test custom controls.
![Page 18: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/18.jpg)
Think Company Reputa-on
“Consumers now have a quality bar, and that bar is going up rapidly. Two years ago, Apple's Maps app on iOS 6 would've been a fine product.” From Engadget, Bardin
![Page 19: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/19.jpg)
Think Trends
For planning purposes, we need to look at trends and sta-s-cs in mobile such as device usage, opera-ng system usage as well as other app or website specific sta-s-cs including language and loca-on.
![Page 20: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/20.jpg)
Think Compe<<on User comments and rankings are worth watching. A scathing review in the app store can make a large impact on your applica-on. Also your app’s compe-tors may not be so obvious.
![Page 21: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/21.jpg)
NEW WAYS OF WORKING How mobile introduces
![Page 22: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/22.jpg)
New tools
From screen capture to app version capturing, we need new tools on mobile than the tools we have had available on the desktop. Your team may build it’s own tools.
![Page 23: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/23.jpg)
Automa-on
“Automa-on in the mobile world is not as easy as it is in the desktop world. Your device is, a_er all, not able to run a large automa-on tool on its own. There’s not the memory to install it. The UI of typical mobile devices is highly dynamic; the user can use swipes and other gestures on the screen to interact with the device.” “Mobile Tes-ng – That’s Just A Smaller Screen, Right?” Stephen Janaway in The Tes-ng Planet
![Page 24: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/24.jpg)
New skills According to the World Quality Report, 2012-‐2013, a study conducted by Capgemini, Soge- and HP, the top priority when tes-ng mobile apps is efficiency/performance, which was cited by 64% of respondents. That was followed by func-onality (48%), portability (46%), UI/ease of use (36%),compa-bility/regression tes-ng (31%), security (18%) and cer-fica-on of applica-on (14%).
![Page 25: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/25.jpg)
UX + Tes-ng
• New bugs • New issues to discover • Screen resolu-on • Responsive design
![Page 26: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/26.jpg)
Test lab
• For both testers and test managers, we have built test labs before and now with mobile devices, we will need to build new labs.
• We may also inves-gate and use both Crowd sourcing and BYOD as solu-ons.
![Page 27: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/27.jpg)
Mobile personas
An approach to design, development and to tes-ng is building mobile personas. Seeing our users as real people and not faceless users.
![Page 28: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/28.jpg)
Context maLers
• What is context?
• Why does it maLer?
• How does context influences tes-ng?
“Context is worth 80 IQ points.” Alan Kay
![Page 29: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/29.jpg)
MOBILE PERSONAS In more detail
![Page 30: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/30.jpg)
Mobile Personas • User models, or personas, are
detailed, composite user archetypes that represent dis-nct groupings of behaviors, artudes, ap-tudes, goals, and mo-va-ons observed and iden-fied during the Research phase. From About Face, Alan Cooper
• The inven-on and development of personas, the refinement of wriLen behavioral blueprints…” Quote from About Face, Alan Cooper
![Page 31: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/31.jpg)
Crea-ng Mobile Personas The benefit of (digital-‐blueprint technology) has been so apparent,” said Rebecca Ayala, a Rudolph + SleLen senior engineer, because the easily update so_ware means they don’t have to worry about workers consul-ng an out-‐of-‐date blueprint, amount other things.
Nearly half of the respondents in a recent Forrester Research Inc. survey said they use a smartphone at least once a week for work, and 21% said the use a tablet for work at least weekly.
Quotes from The Wall Street Journal ar-cle: Meet the New Mobile Workers
![Page 32: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/32.jpg)
Context MaLers
What you are tes-ng changes how you look at tes-ng.
![Page 33: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/33.jpg)
Context Influences
What you are tes-ng changes how you plan tes-ng.
![Page 34: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/34.jpg)
BYOD
How to get access to devices?
• Crowdsourcing • Keynote Device Anywhere
and Perfecto Mobile • Users in other countries • eBay • BYOD
![Page 35: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/35.jpg)
Summary • Review how mobile is different
from the desktop to find new ways to test.
• Recognize the need to learn new terms and technology to work with mobile.
• Consider crea-ng mobile personas to design, develop and test.
• Inves-gate ways to build a test lab.
• Learn more about user interface design.
• Remember our users are no longer tethered to the desktop.
![Page 36: Karen N. Johnson - Mobile Testing keynote delivered at Test Istanbul 2013](https://reader034.vdocuments.us/reader034/viewer/2022052522/554a17bab4c90507558b52a0/html5/thumbnails/36.jpg)
Test Istanbul 2013 Karen N. Johnson email [email protected] twiLer karennjohnson