1

Best Practices for Testing Mobile Applications

Presented by Frank Schloendorn

@MaaS360

Click the link in the chat window to tweet about today’s webinar

@MaaS360 [Share comments, continue Q&A, suggest future topics]

#MaaS360Webinar

Let’s continue the conversation!

3

Poll Question Number One

• What is your company’s current position on testing/certifying mobile applications?–We do not test/certify mobile

applications–We test/certify in-house developed

applications–We test/certify in-house and/or third

party developed mobile applications

3

4 4

What will I learn?

• Challenges of Testing Mobile Applications

• Knowing the App You Are Testing• Types of Testing• Tools/Resources to Aid Testing Efforts• Helpful Hints/Things to Remember

5

Poll Question Number Two

• Which types of mobile apps does your company test or plan to test?– In-House developed applications– Outsourced developed applications– Third Party applications from the app

store/marketplace

5

6 6

Challenges of Testing Mobile Applications

• Some similarities and differences from testing traditional desktop/laptop applications– Multiple platforms (Android, iOS, WP7, etc)– Updates to third party apps are much more frequent

and harder to control– Bigger performance concerns (IE – memory, battery)

• Fragmentation– Software and Hardware– Primarily an Android concern– Multiple hardware specs (processor, memory,

features)

• Limited number of tools to help

7 7

Know the Application You Are Testing

• Is this a in-house developed application? Or one that is from a third party?– For in-house developed apps, testing should begin with early builds

of the application– Development tools should be utilized to profile the application and

look for major design flaws (easier to fix sooner than later)– For third party tools, do some research on the company who makes

the app • Reviews in the app store/marketplace• Frequency of updates/support options• Company background/reputation

• What platforms/OS versions are you supporting/certifying? Does this coincide with the supported stack of the application?– Android (1.x, 2.x, 3.x, 4.x)– iOS (3.x, 4.x, 5.x)– WP7 (7.0, 7.5)– Tablet or Smartphone?– Other?

8 8

Know the Application You Are Testing

• Are there any device ‘Feature’ requirements– GPS, Wi-Fi, Bluetooth, Accelerometer, Touch

Screen, etc.– Important to know from a device support

perspective– Important to know from a performance

perspective

• Are there any ‘Permission’ requirements– Access Contacts, Access Phone, Access

messaging, etc.– Important to know from a security perspective

9

Poll Question Number Three

• Do you currently control which applications a user can install on their mobile device?–Yes–No

9

10 10

Types of Testing

• Functional– Same basic rules of traditional application testing– Does the app perform its functions as intended?

• Usability– Similar to traditional application testing, but with additional

caveats– Is it intuitive, does user understand how to use it?– Is it designed for a mobile experience?– Does it fit the familiar look of other mobile applications?– Does it meet the requirements of the platform if controlled by the

vendor? (Apple)

• Performance– Extremely important for mobile devices– Memory, CPU, and especially power (battery)– Network Utilization also a concern

• Upgrade testing– Test both application and OS upgrades

11 11

Tools to Aid in Mobile Application Testing

• Emulators– Available for all major platforms (Android, iOS, WP7

etc.)– Good for Basic app testing (functional, user

experience)– Not Good for Performance/Resource/Sensor testing– Should never take the place of testing on a real

device

• Apps for Performance testing– First Party: XCode (iOS)– Third Party: Available through marketplace/app store

• Android: System Profiler, Battery Mix, Task Managers

12 12

Tools to Aid in Mobile Application Testing

• Virtual Device Testing– Subscription based– Multiple Vendors

• DeviceAnywhere• Perfecto Mobile

– Remote Access to hundreds of REAL devices• All plaforms

– New devices added regularly

– Save money over buying your own devices to test with

13 13

Tools to Aid in Mobile Application Testing

• Automation– Still in its infancy – not a large selection of options– Built in security of mobile platforms limits capabilities

and cross app testing– Virtual device Companies offer automation

• Requires dedicated devices on their platform• Costly ($$$)

– Third party automation options do exist• Most are platform specific, few are cross platform• Free and paid solutions exist• Most are screen scrapers

– Automating mobile application testing generally requires a higher level of programming knowledge

• Community Testing

14 14

Helpful Hints/Things to Remember

• When developing in-house enterprise apps, make sure testing starts when development is in progress

• Know your target platform/devices– Especially true with Android– Know what versions/platforms you will support

• Don’t assume that because it works on one device, it will work on all

• Don’t underestimate the importance of performance testing

• Always have at least a few physical devices available for testing– Especially older ones (iPhone 3GS, early android, etc.)

15 15

Helpful Hints/Things to Remember

• When possible, have a group of BETA testers to help with real world testing

• Don’t under or over estimate the importance of anecdotal test results

• Know the target audience for your application

16

Poll Question Number Four

• Which mobile platforms do you plan to test apps for?– iOS– Android– BlackBerry–Windows – Other

16

17

MaaS360 Overview

User/Device Enrollment

OTA Configuration & Management

In-depth Inventory & Device Reporting

Improved Visibility & Control

18

Mobile Device Management Features

Apple iOS

> Activate iOS MDM:> Apple certificate-

based> Easy device

enrollment> Push from admin> User self-service

enrollment> In-depth OTA

configuration and policy management:> Passcode,

restrictions, Wi-Fi, VPN, email, and more

> Increased actions:> Full/selective wipe,

lock, update, passcode reset

> Corporate app storefront

> Jailbroken device detection

Android

> Market agent> In-depth OTA

configuration and policy management

> TouchDown integration:> Passcode,

mandatory or disallowed apps, device feature restrictions, Wi-Fi and email profiles, selective wipe

> Increased actions:> Lock, full wipe,

update, locate, query, send message, passcode reset

> Corporate app storefront

> Rooted device detection

ActiveSyncLotus Traveler

> Supports all EAS or Traveler connected devices

> Prevents non-approved devices from accessing corporate email

> Auto-discovery of devices

> Auto-quarantine of devices

> Alerts and workflows to approve or block devices

> Create and enforce ActiveSync policies (e.g., PIN)

> Remote device wipe> Support for Exchange

2007 & 2010> Support for Traveler

8.5.2+

BlackBerry

> Auto-discovery of devices

> Auto-discovery of policies

> Device activation> Visibility into device

inventory> Increased actions:

> Send message> Reset passcode> Change BES policy> Wipe Device> Remove device from

BES> Refresh data

> Support for BlackBerry Enterprise Server 5.0 and higher

> Exchange or Lotus Notes

19

Network World MDM Product Test

“Fiberlink’s MaaS360 is our Clear Choice Winner, based on its strong overall performance, particularly its ease of use. The application initially shocked us, as it was comparatively simple to deploy.”

MaaS360 is the Clear Choice Winner

@MaaS360

Click the link in the chat window to tweet about today’s webinar

@MaaS360 [Share comments, continue Q&A, suggest future topics]

#MaaS360Webinar

Let’s continue the conversation!

21

Wrap-up• Upcoming Webinars (http://maasters.maas360.com/webinars)

• Past Webinars (http://links.maas360.com/webinars)

– What’s New in 4.0 Android Ice Cream Sandwich?– Building Apps for iPhone and iPad– Securing the Kindle Fire in the Enterprise

• Plus lots of How-To content on our website – Mobile Device Management Best Practices

• http://links.maas360.com/mdm

– Mobile Device Management Glossary• http://links.maas360.com/mdm_glossary

• Learn All About the Cloud (AATC)– Presented by The Software & Information Industry Association

• http://siia.net/aatc/2012/video.asp

Questions or follow-up?fschloendorn@fiberlink.com

jpappano@fiberlink.com