Download - Quality Mobile Assurance with IBM Bluemix™
© 2014 IBM Corporation
Continuous Quality for Mobile Apps Reduce your time-to-feedback
© 2014 IBM Corporation2 #IBMMobile
Interactivity Tips
1. Ask A Question
2. Download a PDF copy of today’s presentation
3. Social Networking Tools
© 2014 IBM Corporation3 #IBMMobile
Leigh Williamson (speaker)
@leighawilli
IBM Distinguished Engineer
Nathan Vega (moderator/host)
@IBMBluemix
Developer Engagement, IBM Bluemix
© 2014 IBM Corporation
Continuous quality for mobile apps Reduce your time-to-feedback
Leigh Williamson, IBM Distinguished EngineerIBM Software Group, Mobile App Development
Leigh Williamson, IBM Distinguished EngineerIBM Software Group, Mobile App Development
© 2014 IBM Corporation5 #IBMMobile
Mobile Business Apps Are Changing Everything
High-quality mobile apps that keep users engaged are crucial to keep competition away, maintain customer loyalty, and expand customer base.
© 2014 IBM Corporation6 #IBMMobile
Mobile is changing our view of qualityBug counts are no longer an effective measure of mobile app quality
Quality is no longer just about bugs in the code
Move Testing beyond the Traditional Test Lab
Ratings and user feedback determines quality
New focus on reducing time to feedback vs bug count
© 2014 IBM Corporation7 #IBMMobile
Best practice: continuous delivery for mobile appsbacked by a set of cloud services for each stage of the app lifecycle
DeveloperChecks in codeChecks in code
Mobile build serviceMobile build service
Manual mobile testing servicesManual mobile
testing services
Post-release mobile services
Post-release mobile services
DailyDaily
HourlyHourly
Release
Release
WeeklyWeekly
Automated mobile testing services
Automated mobile testing services
Mobile device farm
IBM Mobile Quality AssuranceIBM Mobile Quality Assurance
© 2014 IBM Corporation8 #IBMMobile
Why does every mobile app need Mobile Quality Assurance?
Mobile app crashes often go undetected causing loss of customers/transactions/purchases
EVERY SECOND of the day, two new comments or ratings are being entered into global app stores, difficult to isolate feedback without bias
Testers typically spend 15-20 minutes PER DEFECT of time-consuming data entry
Businesses outsourcing mobile apps need insight into usability and quality of mobile apps they paid for
Deliver 5 star apps with real-time insight into mobile app usability and user experience in seconds Powerful framework to quickly collect user feedback and deliver it to key stakeholdersSubmit defects in seconds while using the app from mobile deviceReal-time usability feedback, including bugs and crashes from testers, to reduce defects and improve mobile apps experience Aggregate app user feedback, with sentimental analysis analytics to boost app ratings.
User experience testing is manual and lacks true insight of app performance in the real world
© 2014 IBM Corporation9 #IBMMobile 9
Tester End UsersDeveloperLOB/Digital Marketer
“When someone leaves a negative review in the app store, it scars your app for life, you can’t respond to it, and you can’t learn more about the problem in order to fix it quickly.”
- Mobile Orchard
• How effective our mobile app is at engaging customers?
• How can I proactively listen to user feedback, analyze user sentiments and turn them into an actionable strategy?
• How can I get early quality feedback?
• How can I tell if the apps will work with different devices, network carriers, and OS versions?
• How can I get visibility to issues that customers experience in production?
• How can I get the latest and greatest build without wasting my time to track that down?
• How can I quickly submit bug reports with screenshots and device details right from the application?
• How can I provide direct and constructive feedback?
• When will the issues that I have with the app be resolved?
Concerns that make Mobile App Quality different
© 2014 IBM Corporation10 #IBMMobile
IBM Mobile Quality Assurance
• Engage
• Understand
• Guide
• Diagnose
• Implement
• Distribute
• Acquire
• Capture
• Report
• Engage
• Enjoy
• Recommend
Testers UsersDevelopersLine of business
4
23
1
Distribute apps to testers in seconds1
4
23
Report bugs & crashes in app
Report feedback & crashes in app
Assess quality & app store sentiment
ibm.biz/mobilequalityassurance
IBM Worklight Quality Assurance
IBM Mobile Quality Assurance for Bluemix
OR
© 2014 IBM Corporation11 #IBMMobile
Over the air distribution Deliver new builds directly to testers
Developers upload builds and choose recipients (testers)
Testers get notified by MQA then download builds “in app” or from web dashboard
Dev
Owner
User
Test
Builds
Enables developers to distribute new builds to testers
© 2014 IBM Corporation12 #IBMMobile
In-app pre-production feedback Deliver feedback from test to development
Testers send bug reports from “in app” Apps report their own crashes, and send logs Developers diagnose and fix context rich bugs /
crashes Owners prioritize and direct resolution of bugs /
crashes
Dev
Owner
User
Test
Cra
shes
Bug
re
port
s
Log
ging
Enables testers to submit bug reports directly from their phone
© 2014 IBM Corporation13 #IBMMobile
In-app production feedback Deliver feedback from users to
development
Users send feedback “in app” Apps report their own crashes, and send
logs Owners assess feedback and direct
development Developers diagnose and fix crashes
Dev
Owner
User
Test
CrashesFeedback reports
Logging
Enables developers to connect with users
© 2014 IBM Corporation14 #IBMMobile
App store production feedback Analyze app store reviews and ratings to
derive sentiment
Users rate and review apps on app stores
Owners assess sentiment feedback and direct development
Developers review sentiment feedback and improve apps
Dev
Owner
User
Test
App store sentiment
Enables line of business to mine user sentiment
© 2014 IBM Corporation15 #IBMMobile
© 2014 IBM Corporation16 #IBMMobile
Routes to access quality assurance for mobile
IBM Worklight (On-Prem)
IBM Bluemix (SaaS)
Mobile Services
DevOpsServices
The On-Premise version will be marketed as Worklight Quality Assurance.
The SaaS version will be marketed as Mobile Quality Assurance.
QualityAssurance
SaaS vs. On-Premise1.Same features2.Different delivery methods and routes to market3.Different consumption models and charge metrics4.Require separate entitlements
© 2014 IBM Corporation17 #IBMMobile
1 Download the free IBM Worklight Developer Edition: ibm.co/worklightde
Learn more: ibm.com/mobilefirst
23
Ways to get started with IBM MobileFirst
Try IBM Mobile Quality Assurance: https://ibm.biz/mobilequalityassurance
© 2014 IBM Corporation18 #IBMMobile
© 2014 IBM Corporation19 #IBMMobile
Thank You,
QUESTIONS?
© 2014 IBM Corporation20 #IBMMobile
Attendee Services
• Download a copy of today’s presentation
• A recorded version of this seminar will be available at www.eSeminarsLive.com
• View a calendar of our Upcoming Events