ASSURIN
G
QUALITY
IN A
N
AGILE
MOBIL
E
WORLD
J EF
F R
OT
H | C
ON
SU
L TI N
G S
ER
VI C
ES
| BE
NC
HM
AR
KQ
A
11/13-14
/2012
2© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S
R E S E R V E D .
FAILURE SUCKS!
11/13-14
/2012
PLATFORM WARS
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 3
11/13-14
/2012
WHY ASSURE QUALITY?
• Deliver New Capabilities Instead of Fixes
• Prove it Works!• Prove it Works Well!• Prevent Damage to your
Brand!• Increase User Retention!
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 4
11/13-14
/2012
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 5
11/13-14
/2012
MOBILE LIFE CYCLE
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 6
Have an Idea
Build It!
Get Feedback
Fix/Enhance
11/13-14
/2012
WHAT CAN GO WRONG?
• App Doesn’t Deliver Promised Functionality
• App Crashes• App is Buggy• Coding Issues Cause
Secondary Issues• Runaway Memory Usage• App Drains Battery
• Customers Reject Design© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 7
11/13-14
/2012
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 8
HOW DEVELOPERS VIEW TRADITIONAL QA
11/13-14
/2012
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 9
HOW QA VIEWS DEVELOPERS
11/13-14
/2012
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 10
AN EFFECTIVE AGILE TEAM
11/13-14
/2012
QA LIFE CYCLE
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 11
Plan
Design
System TestUAT
Reflect
• Plan: Who, What, Where, When and How
• Design: Build Tests & Data
• System Test: Technical Tests
• UAT: Business User Tests
• Reflect: Improve for Next Time
11/13-14
/2012
TEST PLANNINGWhat Happened in the Past
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 12
11/13-14
/2012
Backlog To Do In Progress
Done
Sprint Scrum Board
Sprint Sprint Sprint Sprint
Release Plan
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 13
TEST PLANNINGHow Agile Does It
Product Backlog
Release Planning Meeting
Sprint Planning Meeting
11/13-14
/2012
QA TASKS
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 14
Get Test Devices
Build Test System
Create Test Cases
Create Test Data
Build Test Automation
Build Test Harness
Get Microwave Oven
Engage Crowd Source Testing
Provision Test Devices
Map Poor Cell Coverage Areas
11/13-14
/2012
GOOGLE “10 MINUTE” TEST PLAN
1. Attributes the adverbs and adjectives that describe the high level concepts testing is meant to ensure. Attributes such as fast, usable, secure, accessible and so forth.
2. Components the nouns that define the major code chunks that comprise the product. These are classes, module names and features of the application.
3. Capabilities the verbs that describe user actions and activities.
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 15
11/13-14
/2012
TEST DESIGN
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 16
User Story Acceptance • Happy Path• Negative
Scenarios• Adhoc
Testing …….. but with a Plan
11/13-14
/2012
EMBEDDED DEVICE TESTING
• Chip Dependencies • GPS/Location
Service• Accelerometers• NFC• WIFI/Cellular• Memory
Management
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 17
11/13-14
/2012
TEST AUTOMATION
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 18
Robot Testing Army
MVC Automation
11/13-14
/2012
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 19
USER ACCEPTANCE TESTING
11/13-14
/2012
REFLECT
© 2 0 1 2 M O B C O N ─ W H E R E M O B I L E M I N D S C O N N N E C T . A L L R I G H T S R E S E R V E D . 20