integrating usability testing into agile updated

Integrating usability testing into Agile A case study from GE Healthcare

Elisa K. Miller emillerupa@gmail.com

Iteration and user involvement in Agile (what we know about Agile)

3 Integrating UX into Agile

2/28/2013

Agile Manifesto values

4 Integrating UX into Agile

2/28/2013

A better match

Since Agile methods appear to more closely match the way people solve problems, they can be helpful in solving the types of complex, interrelated problems organizations increasingly call upon UX designers to address.

Peter Hornsby

Can UX be Agile? UX Matters 10-2009

5 Integrating UX into Agile

2/28/2013

One UX pro gets excited about Agile

First, it’s people oriented.

Second, it is based on the idea or iteration.

Third and most important it’s based on the idea what on every iteration you get real customer feedback and change you direction based on that feedback.

Hugh Beyer, in an interview with Jared Spool UIE Brainsparks, 03/16/2012

What is user experience (UX) and why should I care?

7 Integrating UX into Agile

2/28/2013

Definition of UX

Every aspect of the user’s interaction with a product, service, or company that make up the user’s perceptions of the whole. User experience design as a discipline is concerned with all the elements that together make up that interface, including layout, visual design, text, brand, sound, and interaction.

8 Integrating UX into Agile

2/28/2013

A GREAT user experience

Great user experiences are powered by customer- and user-centric thinking in all aspects of design and development.

9 Integrating UX into Agile

2/28/2013

User experiences that merit design attention occur at every stage of interaction with a product, including:

• Product awareness

• Selection and purchase

• Delivery and packaging

• Installation and configuration

• Training and ramp up

• Operation via the user interfaces

• Support and services

• Maintenance and upgrade

• De-installation and disposal

A Model for integrating UX into Agile

Integrating UX and development Work out the interface for a story before development starts (Sprint 0) Detailed UI design

Final iteration with users

Work with development during the iteration Communicate design to developer

Consult on detailed behavior

Test implementation with users in the following iteration

UX team consults

on story 1

UX team designs story 1

Dev team builds story 1

UX team tests

story 1

UX team designs story 2

Dev team builds story 2

Dev team builds story 3

UX team tests

story 2

UX team consults

on story 2

UX team designs story 3 UX team

consults on story 3

Sprint 1 Sprint 2 Sprint 3 Sprint 4

12 Integrating UX into Agile

2/28/2013

Agile-Usability Breaking it Down Project Definition:

• Strategic design • Initial user research - study of work practice

• Methods: for example, Contextual Inquiry, Observation, Task Analysis, Workflow discussion, Collaboration workgroup

• Activities: Interpretation Sessions and Affinity Diagrams • Deliverables:

• Understand/document the use environment • Develop personas • Develop storyboards and prototypes

• Concept testing – paper prototyping testing (high level) • Methods: Cognitive Walk-throughs & prototype usability testing

(remote) • Usually two rounds for confidence in vision and user stories are

realistic

Sprint 0

13 Integrating UX into Agile

2/28/2013

Agile-Usability Breaking it Down

Project Definition: • Planning for Sprint #1

• Develop use stories (based on task cards) • Develop prototypes for what will be coded in sprint #1 • Test prototypes for sprint #1 development

• Methods: usability testing, cognitive walk through, heuristic analysis, SUS

• Tools: Morae, WebEx

Sprint 0

14 Integrating UX into Agile

2/28/2013

Agile-Usability Breaking it Down

Sprint #1 • Implement UI tested prototypes at Phase 0 for coding in

sprint #1

• Planning for Sprint #2 • Develop use stories • Develop prototypes for what will be coded in sprint #2 • Test prototypes for sprint #2 development

• Methods: usability testing, cognitive walk through, heuristic analysis, SUS

• Tools: Morae, WebEx

• Sprint # 1

Input for Sprint #2

15 Integrating UX into Agile

2/28/2013

Agile-Usability Breaking it Down

Sprint #2 • Implement UI tested prototypes at Sprint #1 for coding in Sprint #2

• Usability Test completed UI from Sprint #1 to ensure nothing was lost in the translation

• Methods: remote usability testing, cognitive walk through, SUS, • Tools: Morae, WebEx

• Planning for Sprint #3 • Develop use stories (based on task cards) • Develop prototypes for what will be coded in Sprint #3 • Test prototypes for sprint #3 development

• Sprint #2

Testing Sprint #1

Input for Sprint #3

16 Integrating UX into Agile

2/28/2013

Involving customers from Sprint 0 on Collaboration workgroups, comprising customers from a variety if practices meet every other week.

They review sketches and prototypes and share how they see their office workflow in relation to the prototype.

The UX rep and Systems Engineers revise the prototypes and review again (iterating).

Case Study: Integrating usability testing into the CPS agile process

18 Integrating UX into Agile

2/28/2013

Centricity Practice Solutions: PM & EMR Project: multiple fixes and upgrades to the CPS product.

Users: • PM (practice management) – Billing office

management & personnel • EMR (electronic medical records) –

Providers (medical staff)

19 Integrating UX into Agile

2/28/2013

Project information:

Nine Scrum teams – five on EMR projects and four on PM projects.

• Sprint Reviews on

Thursday mornings

• Sprint planning on Thursday afternoons

20 Integrating UX into Agile

2/28/2013

Basic usability test cycle

21 Integrating UX into Agile

2/28/2013

Weeks one & two: detailed

22 Integrating UX into Agile

2/28/2013

Weeks three & four detailed

Report to the Scrum Teams

24 Integrating UX into Agile

2/28/2013

Usability test plan

• Identify doctors, nurses and other clinical help to participate

• Find a convenient time for their sessions • Create the usability tasks • Pre-test with internal folks • Conduct the test

25 Integrating UX into Agile

2/28/2013

Tasks (from two different scrum teams) • View current meds search • View prototype and try same search • Discuss • Open prototype of problems panel

– Have them conduct several searches: – Using the search box only – Using the magnifying glass – Start with the Add a problem form

Meds search results

Scrum teams iteration

28 Integrating UX into Agile

2/28/2013

Sprint Planning

Scrum teams take the results of the usability test and review.

Create user stories from the results.

Prioritize – integrate into next Sprint or place in backlog?

29 Integrating UX into Agile

2/28/2013

Making it work

Cooperation from Scrum teams.

Prototypes from systems engineers.

Participation from customers.

30 Integrating UX into Agile

2/28/2013

Other UX techniques involving users

Cognitive walk-through

Contextual inquiry

Face to face usability testing (typically conducted during the biannual user conference).

Site visits.

31 Integrating UX into Agile

2/28/2013

References Carmichael, Sean (2012) Hugh Beyer—Getting Started with UX Inside Agile Development (www.uie.com) Hornsby, Peter (2009) Can UX be Agile? UX Matters (www.uxmatters.com) Nodder, Chris & Jakob Nielsen (2009) Agile Usability: Best practices for User Experience on Agile Development Projects. Nielsen Norman Group (www.nngroup.com) Spool, Jared M (2012) UX and Agile Development: 2012’s Challenged and Opportunities (www.uie.com)