Romanian Testing Conference 2014 – Cluj Napoca Baris Sarialioglu

Testing on The Move, Mobile Testing

My Book

Agenda

¨ Mobile World

¨ Mobile Challenges

¨ Mobile Testing Tools

¨ Testing Contest

Mobile World

We have computers in our pockets!

“Phone users want computers in their pockets. T h e d a y s w h e r e p h o n e s a r e u s e d pr imar i ly to make phone calls and send text messages are quickly fading away”

What Type of Apps?

Source: SmartBear Blog 

Do you plan to enter Mobile Space?

Source: SmartBear Blog 

How long have you been in Mobile Space?

Source: SmartBear Blog 

How many Apps fail?

q More than 50% of users are deleting a Mobile App, if

they encounter just a Single BUG!

q Nearly 50% of apps are downloaded and used just once!

Mobile Challenges

Generic Challenges

# of Platforms / OS 1

Device Variety 2

Displays Pixel Density 3

Hardware Complexity 4

App Complexity 5

Security 6

Carriers & Providers 7

Limitations over PCs 8

Native Apps vs. Mobile Web 9

Test Specific Challenges

Dynamic SDLCs 1

Need for Regression Testing 2

Back-end Testing 3

Performance Testing 4

Do not have the Right Tools 5

Lack of Mobile Testing Experts 6

No Time to Test 7

Do not have Right Methodology 8

Do not have the Devices & Environment 9

Mobile Testing Tools

1-Mobile Consumer Behaviour

http://www.thinkwithgoogle.com/mobileplanet/en/

2-Mobile Purchase Journey

http://think.withgoogle.com/mobile-purchase-journey/

3-Mobile Statistics

http://marketshare.hitslink.com/

4-Mobile Friendliness Testing

http://www.howtogomo.com/en-gb/d/test-your-site/

5-Mobile Friendliness Testing

http://validator.w3.org/mobile/

6-Mobile Usability Testing

http://www.feedbackarmy.com/ http://fivesecondtest.com/

7-Mobile Compatibility Testing

GhostLab, Remote Preview Adobe Edge Inspect, Grunt, Livestyle

8-Mobile Usability Testing - Prototyping

http://balsamiq.com/

9-Mobile Usability Testing - Prototyping

http://www.invisionapp.com/

10-Mobile Performance Testing

http://mobitest.akamai.com/m/index.cgi

11-Mobile Performance Testing

http://mite.keynote.com/

12-Mobile Performance Testing

http://loadimpact.com/

13-Mobile Test Automation

http://www.sikuli.org/

14-Mobile Test Automation

https://app.testobject.com/login/

15-Mobile Test Automation

http://www.telerik.com/mobile-testing

16-Mobile Test Automation

http://www.ranorex.com/mobile-automation-testing.html

17-Live Mobile Testing & Distribution

http://hockeyapp.net/

18-Mobile Beta Testing & Distribution

http://testflightapp.com/

19-Mobile Hardware Testing & Assembly

http://www.ifixit.com/Device/iPhone

Tool Selection Tips

q  Do PoCs!! Try to experience as many tools as possible. q  Check Jailbreaking and Rooting. q  Check if manual scripting (handcoding) is allowed and IDE / language is

adoptable. q  Real Device (Recommended) or Emulator Support. q  Object and/or Image Recognition. q  Functionalities supported – Swipe, drag & drop, zoom, scrolling, pinching,

rotating, shaking etc. q  Check integration with Test Management Tools and/or TM capabilities. q  Check scheduling and ordering of Test Cases/Scenarios. q  Check cross-platform support & Lead time for new OS versions. q  Check reporting & archiving capabilities. q  Check DB access and Data Connectors (White / Grey Box Testing) q  Check Price & Service Support q  Test the tool in your local environment (Network, Firewall, Applications, DBs

etc.)

Mobile Testing Contest

Mobile Testing Contest

q Developers vs. Testers

q 6 questions

q 30 seconds think-time

q First-honk basis answering

q Winner group gets the prize

Question 1

When was the first Mobile call? a.  1946 b.  1973

c.  1986

d.  1992

Times Up!

Question 2

What is “Heisenbug”? a.  A city in Germany b.  A bug that disappears when one

attempts to analyze it

c.  A character in TV series “Breaking Bad”

d.  A bug with catastrophic behavior

Times Up!

Question 3

What was the first SMS message in history?

a.  Hello World b.  I love you

c.  Merry Christmas

d.  Test

Times Up!

Question 4

Which one is true for Emulators & Simulators? a.  Emulators do include hardware

conditions b.  Simulators are more real

c.  Emulators fake the behavior of the

device

d.  Virtual PC’s are examples of

simulators

Times Up!

Question 5

Non-repudiation & integrity are covered in, a.  Network Testing b.  Installability Testing

c.  Security Testing

d.  Conformance Testing

Times Up!

Question 6

How many apps are downloaded from Apple Store in between 2008 & 2013? a.  Around 1 billion b.  Around 20 billions

c.  Around 60 billions

d.  Around 100 billions

Times Up!

Romanian Testing Conference 2014 – Cluj Napoca Baris Sarialioglu