mobile app testing tools & experience - ukisug · mobile app testing ... 7 out of the top 10...

1 © 2013 SAP AG or an SAP affiliate company. All rights reserved.

MOBILE app testing

– tools & experience

Sandip Ghosh, Practice Lead, Global Testing Solutions, SAP

Paul Jackson, Principal Consultant, SAP UK


A discussion on challenges in application testing different

types of mobile applications we lead on to looking at

different options for mobile application testing.

The options will include using SAP Solution Manager, SAP

Quality Center and other tools.

This will then be followed by a Mobile Apps Test Automation

Demo and opportunity to ask questions that will lead to

‘app’y MOBILE testing.

‘app’y MOBILE testing

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 3 Public

Agenda

Challenges in mobile application testing

Types of mobile applications

Test management overview

Mobile application testing

Introducing SeeTest by experitest

Mobile Apps Test Demo

Questions & Summary

Challenges in mobile application testing


Key challenges in testing of mobile applications

Functional testing Variety of mobile devices with different operating systems

High number of combination (e.g. business process variants,

devices, network) in case of changed business processes

Test for user interactions


Mobile application testing Challenges

Different screen sizes, processing power,etc

Different input types: Normal, Touch, Qwerty keyboards

Different battery strength, etc

Variety of mobile devices

Mobile OS is divided under the category of “Smartphones” and normal OS

There are many vendors in Smartphone mobile OS space (fragmented market share)

Each OS has many releases, and there are devices running on different version of the same

Many operating systems

400 + mobile operators in the world with different communication technology like GSM, CDMA, LTE, etc.

Each operator has his own unique combination of infrastructure based protocol

The devices performance depends on the signal strength, location, time of day, etc

Numerous mobile operators

Mobile devices are evolving very quickly

Mobile OS versions and variety is increasing at rapid pace

Fast changing market share for mobile devices, Operating Systems, etc.

Extremely dynamic space

SAP, partner and customer applications

Applications of kind: Web, Hybrid & native Variety of applications



Browser-based Hybrid Native

Accessed via internet on mobile

browsers e.g. m.facebook.com

User interface is native but

content is loaded from web e.g.

facebook app

Standalone & server based

applications


SAP Business Suite

Architecture

SAP Mobile Platform

SAP, Partner, and Custom Apps

Native Apps Hybrid Browser based

Internet

SAP NetWeaver Gateway

1. Variety of mobile apps

2. Connectivity

3. Backend

Test management overview


Test Option 1

Test Option 3

SAP Connector, Quality Manager, Requirements Composer, Team Concert, ...

Business Blueprint

BPCA

Business Blueprint

Test Planning/Management

Test System Setup Test Execution

Change

Deployment Change Impact Analysis

SAP Solution

Update

New SAP

Solution

SAP Test Management Products and capabilities integrated with SAP Solution Manager 7.1 SP07+

Test Workbench Test Automation Framework HP QTP CBTA 3rd Party

Quality Center Business Process Testing HP QTP SAP TAO

Test Automation Test Management

Test Automation Test Management

Test Option 2

http://www.notebookcheck.com/typo3temp/pics/11b0cf7872.jpg

Mobile application testing


Test Management Products and capabilities of Test Option with SAP Solution Manager 7.1

Quality Center by HP

• Requirement

• Test Plan

• Business Process Tests

SAP TDMS

Test Option 2

Business Blueprint

Test Planning/Management

Test System Setup

Test Execution

Reporting

Change

Deployment Change Impact Analysis

Solution Manager

Business Blueprint

• Process documentation

• Business requirements

Solution Manager

BPCA

• Change Impact Analysis

• Test Scope Optimization

Adapter Quality Center by HP

• Test Lab

• Sprinter

• QTP

• Defect

• Test Requirement

• Defects / test results

SAP TAO

• Optimized SAP test scripts

• Accelerated maintenance

• Load and performance

testing

LoadRunner

• Setup of lean test systems

3rd party mobile

automation tools

e.g. SeeTest

DEMO


Flow to create automated test for mobile applications

Business Process SAP Quality Center

Create Test Requirements

Assign tests to

requirements

SAP Quality Center by HP

1. Sign On to SeeTest

2. Access devices

hosted on cloud or

via USB connection

3. Convert the script in

QTP format

On cloud devices

On premise devices

Create Automated Test Script

Store QTP

Script DEMO

Introducing SeeTest by experitest


experitest- Overview

- Market leader in Mobile testing & Monitoring - 7 of 10 largest banks in the world base their

mobile testing on experitest - HP Gold partner and HP Certified Application - Microsoft VSIP Premier partner

Company overview

Software only, simple and quick deployment

Device connectivity: Local or Cloud (remote)

Mobile OS: iOS, Android, Blackberry and WindowsPhone

Identification by Native/Web properties, inc Xpath

Integrative to all test, monitoring & CI environments

Key functionalities

Mobile Test Products

HP UFT/QTP as add-in – which integrates with HP ALM and

SAP Solution Manager

HP Quality Center,Performance Center &LoadRunner

Microsoft Visual Studio and TFS

IBM Rational

Junit, Perl and Python

Jenkins, Team City

Integration options


Worldwide customer base of Fortune 500 companies

Hundreds of users, thousands of 24/7 test users

Example Customers


7 out of the top 10 banks base their mobile testing on SeeTest

Top 10 banks worldwide*:

Barclays

HSBC

American Express

Bank of America

Bank of China

Wells Fargo

JPMorgan

Westpac

Citigroup

TD Bank.

Out of these, 7 (!) have large scale deployments of SeeTestAutomation for mobile testing.

SeeTest from experitest is the tool of choice for the banking industry worldwide.

*based on Wikipedia


SeeTestAutomation • Automation tool • Records & Play on real devices and on emulators • Plugs into UFT/QTP, Visual Studio, RFT, Junit, Python, Perl

SeeTestManual • Manual testing tool •Test on one device manually, get results on 8 devices •Integrated to QC

SeeTestCloud • Device hub located onsite (in the customer VPN) that can be remotely accessed

Product Portfolio


SeeTestCloud Approach for remote testing of mobile devices

1.Access SeeTestCloud via SeeTest tool and

select an appropriate device

2.Device Visualization appears on the User machine

Mobile devices hub

Onsite Mobile cloud

User

HP ALM

3. Over the air/remote installation of the mobile app

4. Record, Execute and View repots on the User

machine as though the device was locally connected

Mobile Apps Test Demo


Questions

Thank You For Your Time


A discussion on challenges in application testing different

types of mobile applications we lead on to looking at

different options for mobile application testing.

The options will include using SAP Solution Manager, SAP

Quality Center and other tools.

This will then be followed by a Mobile Apps Test Automation

Demo and opportunity to ask questions that will lead to

‘app’y MOBILE testing.

‘app’y MOBILE testing

mobile app testing tools & experience - ukisug · mobile app testing ... 7 out of the top 10...

Documents