Mobile Testing Center of Excellence GroupPerfectomobile

Effective mobile test automation using

the hybrid approach & live demo

Enabling Enterprise mobility

Extending Software Quality to Mobile

We will be starting momentarily

Webinar Agenda

4

• Q&A

3

• Mobile automation live demo

2

• Mobile testing challenges

• Native and Visual Objects explained

1

• Intro

∙ Founded 2006

∙ 80+ employees

∙ Office in Boston, London, Israel

∙ Over 600 customers

∙ Fortune 500 enterprises, Telcos, SMBs

∙ SaaS Platform + Licenses

∙ Recurring revenue model

Mobile Application Qualityacross the mobile application lifecycle

MonitoringMonitoring TestingTesting AutomationAutomation

ALM Integration

ALM Integration

OffshoringOffshoringContinuous IntegrationContinuous Integration

Public Cloud Private Cloud

Solution - The MobileCloud™ Platform

SEND SMS NOW to…

First wins Appnificent Air X Racer!

SEND SMS NOW to…1–781-572-7808

First wins Appnificent Air X Racer!

Mobile testing

challenges

Extremely Dynamic & Fragmented Market

Jelly Bean

Jun 2012

ICS

Oct 2011

Honeycomb

Feb 2011

Gingerbread

Dec 2010

Froyo

May 2010

Eclair

Oct 2009Donut

Sep 2009

Cupcake

Apr 2009

iOS 6

Sep 2012

iOS 6

Sep 2012

iOS 5.1

Mar 2012

iOS 5.1

Mar 2012

iOS 5.0

Oct 2011

iOS 5.0

Oct 2011

iOS 4.3

Mar 2011

iOS 4.3

Mar 2011

iOS 4.2

Nov 2010

iOS 4.1

Sep 2010

iOS 4.1

Sep 2010

iOS 4.0

Jun 2010

iOS 4.0

Jun 2010iOS 3.2

Apr 2010

iOS 3.2

Apr 2010

iOS 3.1

Sep 2009

iOS 3.1

Sep 2009

iOS 3.0

Jun 2009

iOS 3.0

Jun 2009

20132012201120102009

Windows 8

Oct 2012

Windows 7

Oct 2009

Mobile web – Browser fragmentation

Difficult to test

Hard to automate dynamic complex environments and apps

Difficult to determine the devices to test on

Need to meet AGILE time frames

Decide when to stop testing (What is the adequate coverage criteria)

Manual testing is imperative as well

Meet external dependencies

OS UI guidelines

Devices availability

Mobile environment - Continue

Mobile Quality

IS a serious

Challenge…

Poll

What is the most complex

aspect around mobile test

automation

Native Objects and

Visual Objects

Objects are the ‘building blocks’ of an application

Buttons, Edit boxes, Lists etc.

Developing mobile automation requires access and robust object recognition

All use cases and test scenario's leverage the application objects (Pressing buttons,

selecting from lists, entering text into textbox’s etc.)

In mobile it is important to use OS Object level analysis

Web objects are critical for web based mobile applications (DOM)

Objects Introduction

Represents the available UI controls

Returns the texts of the current application

Complete control text is returned, including partially displayed text located outside

Supports all languages - information about the text language is not required

Text compare is completed with a simple string compare. Provides 100% accuracy that is

sensitive to small characters, such as punctuation marks

Match grade is either 0% or 100%

Control region and text are known, but not the order or the exact structure on the screen

Native control text retrieval is fast!

Performs the operation on the found control

Object Level Analysis – Pro’s/Con’s

In this example, the retrieved text is "name123"

Represents the actual real user experience (WYSIWYG)

Detects visual problems such as button heights, incomplete text, overwrite elements, etc…

Best when used to analyze images or complex applications (Games)

Indifferent to the device OS, Supports all languages

Returns the texts that appear on the screen:

Includes everything

Control text that is too long to display in the control region on the screen is partially displayed

followed by ‘…’

Visual analysis is more time consuming than native control analysis

Performs the operation on the found region

Link to a useful white paper on mobile objects can be found here:

http://help.perfectomobile.com/article/AA-01248/

Visual Objects (OCR) Pro’s/Con’s

In this example, the retrieved text is "name123 x"

Examples of OCR vs. Object Level analysis

In the above image, Object level

analysis won’t detect the Logon

button issue on the HTC device,

OCR will

In the above image, Object level

analysis won’t detect the

Truncated ‘Time’ label, OCR will

Live Demo

Sveta Kostinsky

Questions &

Answers

If you have any further questions,

please contact:

Perfecto Mobileinfo@perfectomobile.com

Thank You!

Join us on LinkedIn

Mobile Testing Center of Excellence