user acceptance testing: make the user a part of the team

16
T14 Concurrent Class 10/3/2013 1:30:00 PM "User Acceptance Testing:Make the User a Part of the Team" Presented by: Susan Bradley Grange Mutual Insurance Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ [email protected] www.sqe.com

Upload: techwellpresentations

Post on 05-Dec-2014

382 views

Category:

Technology


0 download

DESCRIPTION

Adding user acceptance testing (UAT) to your testing lifecycle can increase the probability of finding defects before software is released. The challenge is to fully engage users and assist them in becoming effective testers. Help achieve this goal by involving users early and setting realistic expectations. Showing how users add value and taking them through the UAT process strengthens their ability and commitment. Conducting user acceptance testing sessions as software functionality becomes available helps to build confidence and capability—and find defects earlier. Susan Bradley shares a five-step process that you can use in your organization to conduct user acceptance testing. Learn to conduct training, set up daily testing expectations, assign test cases to users, create a shared information site for both test case management and feedback documentation, conduct a review of noted issues with all interested parties, and participate in a retrospective regarding the UAT process to improve the process for next time.

TRANSCRIPT

Page 1: User Acceptance Testing: Make the User a Part of the Team

T14 Concurrent Class

10/3/2013 1:30:00 PM

"User Acceptance Testing:Make

the User a Part of the Team"

Presented by:

Susan Bradley

Grange Mutual Insurance

Brought to you by:

340 Corporate Way, Suite 300, Orange Park, FL 32073

888-268-8770 ∙ 904-278-0524 ∙ [email protected] ∙ www.sqe.com

Page 2: User Acceptance Testing: Make the User a Part of the Team

Susan Bradley

Grange Mutual Insurance

A certified software testing engineer (CSTE) for seven years, Susan Bradley has worked in

quality assurance and testing for sixteen years. Today Susan strives to bring best manual

testing processes to Grange Mutual Insurance where she is the enterprise QA software process

architect. She had the opportunity to work on the top project initiative at Grange and interact

closely with the business units to ensure a quality product. Susan is a member of the Central

Ohio Quality Assurance Association.

Page 3: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

1

StarWest 2013Susan Bradley

Grange Insurance/QA Software Process Architect

•Came from the business unit•Quality Assurance professional-17 years in both agile & waterfall•Young Adult Mystery Author

Page 4: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

2

Who’s responsible for quality?

Page 5: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

3

� Customer?

� Bureau of Motor Vehicles?

� Police?

� Jim?

� Database?

� Culture?

� By embracing the QA process over just having a QA department helps to assure reaching business goals:◦ Faster

◦ Less Expensive with less risk

◦ Higher customer and employee satisfaction

Page 6: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

4

Jim

QA

BusinessUser

Page 7: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

5

Nina

QA Business User

New Culture

“Trap”

http://www.retro-housewife.com/blog/uploaded_images/fireman-w-hose-733793.jpg

Page 8: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

6

http://whatconsumesme.com/wp-content/uploads/2010/03/4-50.jpeg.jpg

� What is the business goal?◦ Faster

◦ Less Expensive

◦ Less Risk

� How did UAT affect Jim & Nina?◦ Morale

◦ Job satisfaction

◦ Risk to company

Page 9: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

7

What do these have in common?

Page 10: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

8

� Commercial Small Business Owner Product (BOP) Implementation

� Agile SDLC

� 5 Step Process

� Defects/Results from UAT

� Implementation to Production

� Net result of Defect Ratio after implementation (Product 1 vs. BOP)

� User by-in

Page 11: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

9

� 1)Identify and engage users

� 2) Create Test cases

◦ Day 1: Step by Step Process

◦ Day 2: Guided Scenarios

◦ Day 3: Real submitted applications

Page 12: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

10

� 3) Training for UAT

◦ What functionality is available for testing

◦ Where they will document their results

◦ Overview of the process

� 4) Review defects with users & project team◦ Categorize

◦ Prioritize

Page 13: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

11

� 5) Perform Retro on the process and experience

� 1) Identify and engage users

� 2) Create Test cases

� 3) Training for UAT

� 4) Review defects with users & project team

� 5) Perform Retro on the process and experience

Page 14: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

12

� During 4 UAT sessions, 468 observations, bugs, questions & suggestions were recorded

� Defect Ratio between Product X & BOP

Page 15: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

13

� Product X continues to be challenging to maintain

User Acceptance Testing

QA Business User

New Culture

“Trap”

Page 16: User Acceptance Testing: Make the User a Part of the Team

9/19/2013

14

� E-mail: [email protected]

� Twitter: @susanxbradley