Choose the Right Devices for Testing this Quarter

August, 2015

Eran KinsbrunerDir, Product MarketingMobile Technical EvangelistPerfecto Mobile

Some Housekeeping before we start

Submit questions using the Q&A

panel.

Participate in the polls

Watch your email for a copy of the

recording and slides

Complete the survey following the presentation

Agenda

• Framework and methodology• 2nd Edition index drill down and insights• Adding your own analytics• Heads-up – market calendar• Q &A

Introducing Perfecto Mobile

Dominant leader & visionary

Strong Ecosystem

Perfecto @ a glance

Partnering with Enterprises to create better mobile apps faster with continuous quality

“Perfecto Mobile marks shift in mobile apps QA with Continuous Quality Lab”

4

Setting the bar for market success

• Founded in late 2006, Business HQ in Boston • Over 200 employees globally• Fortune 500 customer base

The Continuous Quality Coverage Framework™ Answer the customer’s most common question:

“Which devices/form factors should I test to assure sufficient

market coverage?”

It’s Fundamental all around

For the Business it’s market coverage

• Great end user experience

• Build requirement for IT

• Optimize user engagement & rating

For the Dev/QA it’s test coverage

• Optimize process

• Discover bugs early, mitigate risk

• Continuously test on what matters

Digital Predator Or Digital Prey?

Mobile Test Coverage Index – 2nd Edition Aug 2015

• Market Analysis • 4,000+ Devices• 460,000 Hours of Mobile

Cloud Testing

New!

Mobile Test Coverage Index – Q2 2015 Key Insights & Trends

iOS & Android Shares:• iOS dominates U.S• Android in Europe is as

follows:• Clear win in Germany • Samsung & Apple are

the same in UK• EU5 aggregated –

Android wins

Nexus Devices Share• Small both in U.S and

Europe• Must be included in each

Index!

Trends & Q3• Huawei is the 3rd smartphone

vendor worldwide • Its new Ascend P8 marked as

strong leader!• Key iOS & Android Releases in Q3

• Android M 6.0 ( LG & Huawei)• iOS 9 (iPhones 6S/6S

Plus/iPad Pro (12.9’’))• Legacy devices are critical (Samsung

S3 e.g.)

Global Mobile Market Share – Q2 2015

Source: Strategy Analytics

Global Mobile Phone Vendor Marketshare (%) Q2 ‘14 Q2 ‘15

Samsung 22.3% 20.5%

Apple 8.2% 10.9%

Huawei 4.8% 7.0%

Microsoft 11.8% 6.4%

Xiamoi 3.5% 4.6%

Others 49.4% 50.6%

Total 100.0% 100.0%

One of the 2 new Google Nexus Devices

85%

3% 2%

iOS 8iOS 7Earlier

Which OS versions and Screen sizes to include in the mix?JellyBeans & KitKat == ±74% distribution

Lollipop – Must OS in any Index

Legacy devices – still uses GingerBread & ICSAndroid Marshmallow (6.0) – Beta available today for testing on Nexus devices

• Minimum of 6 devices (Smartphones & Tablets)• * iOS 9 Beta – Must be

included

Minimum of 8 devices(Smartphones & Tablets)

Index Aug-2015 Edition

Poll

What is the minimal number of devices & OS’s mix (iOS/Android) which you currently test on?

Coverage Target

The minimal recommended device list matched to relevant OS list

Additional devices and OS for enhanced 50% market coverage

Highest recommended coverage of Devices and OS’s with more legacy and new devices/OS’s included

80%50%30%

10-16Devices

17-25Devices

26-32Devices

U.S Index Q2 2015

Nexus DevicesLegacy Devices

UK Index Q2

UK Index Q2

iPhones & Samsung – Top 5

Top Windows PhoneDevices

Germany Index Q2

Germany Index Q2 2015

Legacy & Critical

Emerging In EMEA

Samsung Dominates In Germany

Sony Xperia M5Sony Xperia C5 Ultra

Test Coverage Optimization Process2. Lab Sizing

Me

Analytics

Teams Projects

SDLC Cycle

Requirements

v

Market

My Space

Popular & emerging

The Index

1. Coverage

Industry trends & insights

Which device types to include in the mix?

Reference Devices/OS

Popular Devices/OS

Legacy Devices/OS

Emerging Devices/OS

v

Analytics-based profiling

Product/ marketing requirements

“ Look inside yourself and you Can see the universe.”- Brian Herbert

Case Studies

• Large European Company– Preliminary Index overview– Analytics received & Analyzed– Enhanced Index/Coverage achieved(Merge &

Complement) with focus on:• New & Upcoming devices & OS’s• Android Tablets• Refresh Rate

v

22%

64%

14%

VisitsAndroid iOS Blank

32%

56%

12%

LoginsAndroid iOS Blank

Transactions OS Breakdown

Recommended List --------------

With 25% Device Refresh Rate (Quarterly)

What does it take to cover the REALend user experience?

v

Device & Platform

Model

OS Version

Screen Size

Form Factors v

Environment

Location

Network

v

Conditions

Signal Strength

Load

Others

Stay Engaged

• Mobile Test Coverage Download Page– http://go.perfectomobile.com/test-coverage-index/

• LinkedIn Group– https://www.linkedin.com/grp/home?gid=8358292

Thank You

Please Remember To Complete The Survey