better mobile tests for better user experience

JeanAnn Harrison & Phil Lew

Better Mobile Testing for Better User

Experience

XBOSoft info

• Founded in 2006• Dedicated to software quality

• Software QA consulting• Software testing services

• Offices in San Francisco, Beijing, Oslo and Amsterdam

On the XBO side:

Amy Jan •

Upcoming Webinar : 9/26/13 11am ESTPlan your Attack-Software Testing for Mobile and Embedded Devices – with Jon Hagar

Housekeeping• Everyone except the speaker is muted

• Questions via the gotowebinar control on the right side of your screen

• Questions can be asked throughout the webinar, we’ll try to fit them in when appropriate

• General Q & A at the end of the webinar

• You will receive info on recording after the webinar

Jean Ann Harrison Copyright 2013 4

About Phil LewDr. Philip Lew, CEO of XBOSoft, is a regular speaker at QA and software testing conferences, published author and is currently doing research on user experience.

Mr. Lew is also an Adjunct Professor at Alaska Pacific University and Project Management College teaching graduate courses in software engineering, software quality assurance, IT project management, and IT Governance.

About JeanAnn Harrison

JeanAnn Harrison regularly speaks at industry conferences and is published in software testing magazines.

She has years of experience with mobile testing and is a well-known figure in the QA and software testing community.

Besides software testing , JeanAnn is an avid fan of baseball & ice skating.


WEBINAR: BETTER MOBILE TESTING FOR

BETTER USER EXPERIENCE

JEAN ANN HARRISONSoftware Test Consultant for Project Realms.

FOR MOBILE AND EMBEDDED TESTERS

Jean Ann Harrison Copyright 2013

Dr. Philip LewCEOXBOSoft, Inc

7

AGENDA


• Types of devices & Types of Mobile Apps

• Definition of User Experience• Types of Tests• Examples of UX Tests • Conclusion• Q & A

8

MOBILE/EMBEDDED SOFTWARE & DEVICES

• Mobile phones, tablets• Proprietary devices: mobile heart monitors, law enforcement

ticket generators, restaurant personnel taking customer orders on devices, GPS devices, PDAs

• Embedded Software examples: automobile’s computer system, air traffic control systems, airplane navigation system, drug infusion pumps in hospital rooms, elevators, cameras, robots


TYPES OF MOBILE APPS

• Native Applications• Local to device

• Hybrid Applications• Local to device but

interacts w/internet

• Web Applications• Not local to device. All

interactions on internet


USER EXPERIENCE- DEFINITION


USEFUL

DESIRABLE

FINDABLE

CREDIBLEVALUABLE

USABLE

ACCESSIBLE

11

USER EXPERIENCE - TESTS


• Look - display• Feel - accessibility• Performance• Installations/Downloads• Trainability - Intuitive Experience• Recovery of Unexpected Behavior

12

LOOK - DISPLAYS

• Text size• Font of text• Filling out screen

display surface• Colors• Brightness


IPAD MINI TWITTER HOME PAGE


• Useful: Navigation button location useful?

• Accessibility: Is the Font readable?• Usable: Does the display fill out

the screen?• Desirable: Are the colors pleasing

to the eye?• Findable: Are functions easy to

see?• Valuable: Are these functions

displayed valuable for the user on the Home Page?

14

IPAD2 TWITTER HOME PAGE


• Useful: Text size work for the page?






15

IPHONE 5 TWITTER HOME PAGE








16

KINDLE FIRE TWITTER HOME

PAGE








17

ANDROID PHONE TWITTER HOME

PAGE








18

FEEL/ACCESSIBILITY TESTS• Navigation - scrolling• Screen Rotation -

Portrait/Landscape• Images & Links reaching

same target grouped into one touch zone?

• Language accessible?• Is all functionality

viewable?


IPAD2 ROTATION OF CONNECT PAGE


IPHONE ROTATION OF CONNECT PAGE


Currently, there is no way to rotate the screen on the iPhone to view this application's page in Landscape view. iOS7 was not tested. Only iOS6 was tested.

21

KINDLE ROTATION OF CONTACT PAGE


ANDROID PHONE ROTATION OF CONTACT PAGE


PERFORMANCE

• Downloading apps• Removing apps• Network Communication• Onboard Database searches• Interrupts & Resume• Device/battery temperatures


PERFORMANCE - USEFUL? IPAD2 PERFORMANCE


What happens when downloading of an application is a useful performance measurement.

25

PERFORMANCE - USEFUL? KINDLE(ANDROID)

PERFORMANCE


What happens when downloading of an application is a useful performance measurement.

26

PERFORMANCE - USEFUL? ANDROID PHONE PERFORMANCE


Clear progression of the installation. The user knows exactly where the downloading/installation is in process

27

TRAINABILTY TESTS - NEED HELP?

• Users learning to use the application without Lookup Help

• Icons display functional usage• Device differences in display are easily transferable


TRAINABILITY: USEFUL, FINDABLE, ACCESSIBLE - IOS


TRAINABILITY: USEFUL, FINDABLE, ACCESSIBLE -

ANDROID


CONCLUSION• Testing the User Experience can be defined by considering how useful the

application is for the user's purpose - why did the user download the application?

• Testing the User Experience can be defined by how easily findable and accessible the application's functionality is - can user navigate through the functionality?

• Testing the User Experience can be defined as to how desirable and whether those desires meet the value of the user's purpose - does the application look and feel make the user want to continue to use?

• Testing the User Experience can be defined as useable where the user can figure out how to use the display to achieve purpose - can the user understand what the icons ' purposes are.


JEAN ANN HARRISON’S CONTACT INFORMATION

• EMAIL: [email protected]• Twitter: https://twitter.com/JA_Harrison Or @JA_Harrison• Project Realms Inc website:

www.projectrealms.com


Q & A

32

mailto:[email protected]

https://twitter.com/JA_Harrison

https://twitter.com/JA_Harrison

http://www.projectrealms.com/

REFERENCES• Was assisted with submissions of IOS devices screenshots by the following:

Teri Charles, Software Tester, bouldertester.blogspot.com Twitter: @booksrg8

Michael Corum, Manager, Quality Assurance for a large media company Blog: http://tnridgeback.blogspot.com/

• USER EXPERIENCE - DEFINITIONhttp://semanticstudios.com/publications/semantics/000029.php

• Performance slide of testshttp://www.organisationscience.com/styled-6/


http://bouldertester.blogspot.com/

http://tnridgeback.blogspot.com/

http://tnridgeback.blogspot.com/

Questions & Answers

Follow us: @XBOSoftQuestions: [email protected]

408-350-0508


Thanks for joining us today!

Join us next week for 9/26/13 at 11am (EST)

Plan your Attack-Software Testing for Mobile and Embedded Devices

A webinar with Jon Hagar author of "Software Test Attacks to Break Mobile and Embedded Devices"

http://www.xbosoft.com/knowledge_center/software_quality_blog/


better mobile tests for better user experience

Technology

text size

functions

software testing

functions

font readable

colors pleasing

embedded devices

mobile testing