|

Creating Mobile Apps That Win Developing, Testing & Launching Apps Users Love Doron Reuveni | uTest CEO | doronr@utest.com

The Challenge

|

Mobile Apps Not Same As Web Or Desktop

•  No company or industry is immune B2B: –  Back-office: CRM, ERP, HR, financials –  Productivity: doc, spreadsheet, preso –  Collaboration: email, IM, publishing –  Logistics: shipping, tracking, inventory

•  70B downloads (2011 + 2012) across 1.5M public apps

B2C: –  Retail: geo-aware m-commerce –  Media: going purely digital –  Travel: bookings, check-ins, maps –  Financial: banking, trading, forex

Mobile Is Booming

Source: Business Insider, 2012

Mobile Is Just Getting Started

Mobile App Quality Is More Complex

•  This is Android devices only •  Doesn’t account for OS versions, carriers or locations

Mobile App Quality Is Judged Harder

•  Users less tolerant of spotty quality

•  Social & app stores give every user a megaphone

•  Switching costs lower than ever

•  Cost of imperfect app quality has spiked

So What Could Possibly Go Wrong?

Cars E-Readers Household Appliances

Fragmentation of users, devices, OSes, browsers, locations

Oh, And It’s Not Just Mobile

Phones & Tablets Laptops & Desktops

Connected TVs

Gaming Consoles

The Challenge

|

Implications For Tech Execs

Companies’ Testing Portfolio

In-House Manual Testing

Outsourced Manual Testing

In-House Test

Automation

Outsourced Test

Automation

In-The-Lab Testing

So How Do You Test Mobile?

App quality vectors, both inside the lab and in the wild:

Functionality: The degree to which software functions as designed

Usability: The degree to which apps are intuitive to use

Security: The degree to which the application is secure & private

Load: The degree to which software performs while under peak usage

Localization: The degree to which the product fits in various markets

How Do You Listen To Users?

•  Mobile app analytics tools –  Implicit listening tools like Flurry,

Mixpanel & Omniture -  Let you measure what users are doing

–  Explicit listening tools like Applause -  Lets you measure what users are saying

–  Different sides of same coin -  Both necessary for informed decisions

Tools For Outside-In App Quality

App  Store  Analy-cs  

In-House Tech

Leaders

Apps That Win

•  Mobile has different recipe for success –  Exponentially more diverse test matrix

-  Devices + OSes + Carriers + Locations + User demographics

–  Users less tolerant of spotty quality –  Users’ quality complaints no longer private

•  CIO orgs must play catch-up –  By continuing to improve inside the lab –  By moving beyond it, where users work, live and play –  Winners combine: in-the-lab testing + in-the-wild testing + analytics

•  Must find most effective way to test in the wild –  In-the-wild testing services across the SDLC –  Build distribution and bug & crash reporting –  Measuring & monitoring app quality and user satisfaction

Tech Exec Takeaways

The Challenge

|

Let’s Discuss