integrating usability testing into agile updated
DESCRIPTION
This presentation describes a case study from GE Healthcare, where I conducted usability testing every two weeks in conjunction with the sprint cycles.TRANSCRIPT
Integrating usability testing into Agile A case study from GE Healthcare
Elisa K. Miller [email protected]
Iteration and user involvement in Agile (what we know about Agile)
3 Integrating UX into Agile
2/28/2013
Agile Manifesto values
4 Integrating UX into Agile
2/28/2013
A better match
Since Agile methods appear to more closely match the way people solve problems, they can be helpful in solving the types of complex, interrelated problems organizations increasingly call upon UX designers to address.
Peter Hornsby
Can UX be Agile? UX Matters 10-2009
5 Integrating UX into Agile
2/28/2013
One UX pro gets excited about Agile
First, it’s people oriented.
Second, it is based on the idea or iteration.
Third and most important it’s based on the idea what on every iteration you get real customer feedback and change you direction based on that feedback.
Hugh Beyer, in an interview with Jared Spool UIE Brainsparks, 03/16/2012
What is user experience (UX) and why should I care?
7 Integrating UX into Agile
2/28/2013
Definition of UX
Every aspect of the user’s interaction with a product, service, or company that make up the user’s perceptions of the whole. User experience design as a discipline is concerned with all the elements that together make up that interface, including layout, visual design, text, brand, sound, and interaction.
8 Integrating UX into Agile
2/28/2013
A GREAT user experience
Great user experiences are powered by customer- and user-centric thinking in all aspects of design and development.
9 Integrating UX into Agile
2/28/2013
User experiences that merit design attention occur at every stage of interaction with a product, including:
• Product awareness
• Selection and purchase
• Delivery and packaging
• Installation and configuration
• Training and ramp up
• Operation via the user interfaces
• Support and services
• Maintenance and upgrade
• De-installation and disposal
A Model for integrating UX into Agile
Integrating UX and development Work out the interface for a story before development starts (Sprint 0) Detailed UI design
Final iteration with users
Work with development during the iteration Communicate design to developer
Consult on detailed behavior
Test implementation with users in the following iteration
UX team consults
on story 1
UX team designs story 1
Dev team builds story 1
UX team tests
story 1
UX team designs story 2
Dev team builds story 2
Dev team builds story 3
UX team tests
story 2
UX team consults
on story 2
UX team designs story 3 UX team
consults on story 3
Sprint 1 Sprint 2 Sprint 3 Sprint 4
12 Integrating UX into Agile
2/28/2013
Agile-Usability Breaking it Down Project Definition:
• Strategic design • Initial user research - study of work practice
• Methods: for example, Contextual Inquiry, Observation, Task Analysis, Workflow discussion, Collaboration workgroup
• Activities: Interpretation Sessions and Affinity Diagrams • Deliverables:
• Understand/document the use environment • Develop personas • Develop storyboards and prototypes
• Concept testing – paper prototyping testing (high level) • Methods: Cognitive Walk-throughs & prototype usability testing
(remote) • Usually two rounds for confidence in vision and user stories are
realistic
Sprint 0
13 Integrating UX into Agile
2/28/2013
Agile-Usability Breaking it Down
Project Definition: • Planning for Sprint #1
• Develop use stories (based on task cards) • Develop prototypes for what will be coded in sprint #1 • Test prototypes for sprint #1 development
• Methods: usability testing, cognitive walk through, heuristic analysis, SUS
• Tools: Morae, WebEx
Sprint 0
14 Integrating UX into Agile
2/28/2013
Agile-Usability Breaking it Down
Sprint #1 • Implement UI tested prototypes at Phase 0 for coding in
sprint #1
• Planning for Sprint #2 • Develop use stories • Develop prototypes for what will be coded in sprint #2 • Test prototypes for sprint #2 development
• Methods: usability testing, cognitive walk through, heuristic analysis, SUS
• Tools: Morae, WebEx
• Sprint # 1
Input for Sprint #2
15 Integrating UX into Agile
2/28/2013
Agile-Usability Breaking it Down
Sprint #2 • Implement UI tested prototypes at Sprint #1 for coding in Sprint #2
• Usability Test completed UI from Sprint #1 to ensure nothing was lost in the translation
• Methods: remote usability testing, cognitive walk through, SUS, • Tools: Morae, WebEx
• Planning for Sprint #3 • Develop use stories (based on task cards) • Develop prototypes for what will be coded in Sprint #3 • Test prototypes for sprint #3 development
• Sprint #2
Testing Sprint #1
Input for Sprint #3
16 Integrating UX into Agile
2/28/2013
Involving customers from Sprint 0 on Collaboration workgroups, comprising customers from a variety if practices meet every other week.
They review sketches and prototypes and share how they see their office workflow in relation to the prototype.
The UX rep and Systems Engineers revise the prototypes and review again (iterating).
Case Study: Integrating usability testing into the CPS agile process
18 Integrating UX into Agile
2/28/2013
Centricity Practice Solutions: PM & EMR Project: multiple fixes and upgrades to the CPS product.
Users: • PM (practice management) – Billing office
management & personnel • EMR (electronic medical records) –
Providers (medical staff)
19 Integrating UX into Agile
2/28/2013
Project information:
Nine Scrum teams – five on EMR projects and four on PM projects.
• Sprint Reviews on
Thursday mornings
• Sprint planning on Thursday afternoons
20 Integrating UX into Agile
2/28/2013
Basic usability test cycle
21 Integrating UX into Agile
2/28/2013
Weeks one & two: detailed
22 Integrating UX into Agile
2/28/2013
Weeks three & four detailed
Report to the Scrum Teams
24 Integrating UX into Agile
2/28/2013
Usability test plan
• Identify doctors, nurses and other clinical help to participate
• Find a convenient time for their sessions • Create the usability tasks • Pre-test with internal folks • Conduct the test
25 Integrating UX into Agile
2/28/2013
Tasks (from two different scrum teams) • View current meds search • View prototype and try same search • Discuss • Open prototype of problems panel
– Have them conduct several searches: – Using the search box only – Using the magnifying glass – Start with the Add a problem form
Meds search results
Scrum teams iteration
28 Integrating UX into Agile
2/28/2013
Sprint Planning
Scrum teams take the results of the usability test and review.
Create user stories from the results.
Prioritize – integrate into next Sprint or place in backlog?
29 Integrating UX into Agile
2/28/2013
Making it work
Cooperation from Scrum teams.
Prototypes from systems engineers.
Participation from customers.
30 Integrating UX into Agile
2/28/2013
Other UX techniques involving users
Cognitive walk-through
Contextual inquiry
Face to face usability testing (typically conducted during the biannual user conference).
Site visits.
31 Integrating UX into Agile
2/28/2013
References Carmichael, Sean (2012) Hugh Beyer—Getting Started with UX Inside Agile Development (www.uie.com) Hornsby, Peter (2009) Can UX be Agile? UX Matters (www.uxmatters.com) Nodder, Chris & Jakob Nielsen (2009) Agile Usability: Best practices for User Experience on Agile Development Projects. Nielsen Norman Group (www.nngroup.com) Spool, Jared M (2012) UX and Agile Development: 2012’s Challenged and Opportunities (www.uie.com)