Agile Quality Assurance Reference Model

Jacob Sandnes3/23/15

2

Road Map

• Introduction• Agile and CMMI• Current Models• Agile QA-RM• Evaluation of Agile QA-RM• Conclusions

3

Introduction • A subset of quality management is quality

assurance. – Quality assurance is essential to improving

consistency.

• QA improves:– Practices – Processes– Product

4

Introduction

• Industry utilizes maturity models. – CMMI; PPQA – MPS.BR; GQA

• Agility is prevalent in industry.– XP, SCRUM

• How is QA implemented in an organization using agile methodologies and CMMI?

5

Introduction

• Agile QA-RM – Combines CMMI and agile quality assurance– Utilizes literature review and case study to define

model.• Distinction between software quality

assurance and quality assurance.

6

Road Map

• Introduction• Agile and CMMI• Current Models• Agile QA-RM• Evaluation of Agile QA-RM• Conclusions

7

Agile and CMMI

• Agility in software development is designed around.– Adaptability to requirement change – Iterative and/or incremental – Developing prototypes

• Agile QA is implicit– Standups, retrospectives…etc.

8

Agile and CMMI

• CMMI is a framework to help refine processes.• It consists of 6 levels – They are incomplete, performed, managed,

defined, quantitatively managed, and optimizing• PPQA is subsection of CMMI defining quality

assurance.• CMMI QA is explicit– Document driven

9

Road Map

• Introduction• Agile and CMMI• Current Models• Agile QA-RM• Evaluation of Agile QA-RM• Conclusions

10

Current Models

• Reference models exist that define performance and maturity in:– reuse, quality, or testing– adaptability, feasibility, improvement– adoption of agile methodologies (agile maturity

model)

11

Current Models

• There are quality assurance models like– Agile quality assurance model (no CMMI

adherence)– Agile software quality (small teams and only

applies to level 2 of CMMI) • None exist to define QA in environments with

both agility and CMMI.

12

Road Map

• Introduction• Agile and CMMI• Current Models• Agile QA-RM• Evaluation of Agile QA-RM• Conclusions

13

Agile QA-RM

• Purpose:– Defines, implements, and improves QA processes

in organization with maturity models and agile methodologies.

– Assesses current maturity in terms of QA – Assists in improving quality through adoption of

practices.

14

Agile QA-RM

• 5 maturity levels – Informal QA, Managed QA, Defined QA, Measured

QA, Optimized QA• 18 process areas each with a purpose, result,

and work product.

15

Agile QA-RM

• Level 1: Informal QA– QA is (ad hoc). – Reviews, audits, an monitoring can be

implemented.– No coordination and defining of specific QA roles– No process groups– Prior to implementation of agile QA-RM

16

Agile QA-RM

• Level 2: Managed QA– Implementation of agile QA actions at a project

level.– Agile QA process defined. – Defining of QA individual or team.– Less documentation and more activities.– Any documentation should briefly report activity

results.– Addresses level two of CMMI.

17

Agile QA-RM

• Level 2: Managed QA– Process areas • Quality assurance planning • Team assistance • Process assessment • Product assessment• Noncompliance management• Customer satisfaction assessment

18

Agile QA-RM

• Level 2: Managed QA

19

Agile QA-RM

• Level 3: Defined QA– Organizational level.– Repository of lessons learned– QA team or group developed across all projects.– Any team member can contribute lessons learned.– Addresses level three of CCMI

20

Agile QA-RM• Level 3: Defined QA– Process areas• Organizational quality assurance • Lessons learned management • Training • Knowledge management • Quality assurance quality • Integration management • Risk analysis • Cost analysis

21

Agile QA-RM

• Level 3: Defined QA

22

Agile QA-RM

• Level 4: Measured QA– Apply metrics to improve process and product

quality. – Also can be used for self-organizing teams an

sustainable development paths.– Corresponds to level 4 CMMI

23

Agile QA-RM

• Level 4: Measured QA– Process areas• Quality assurance measurement• Self-organization and sustainability

24

Agile QA-RM

• Level 4: Measured QA

25

Agile QA-RM

• Level 5: Optimized QA– Use data from measured QA to implement

changes.– Minimizes non-compliance and maximizes

customer satisfaction.– Corresponds to level 5 CMMI

26

Agile QA-RM

• Level 5: Optimized QA– Process areas• Defect prevention• Decision making support

27

Agile QA-RM

• Level 5: Optimized QA

28

Agile QA-RM

• Application of AGILE QA-RM– Should be incremental. – Ideal for organizations wanting to implement agile

QA and CMMI together.

29

Road Map

• Introduction• Agile and CMMI• Current Models• Agile QA-RM• Evaluation of Agile QA-RM• Conclusions

30

Evaluation of Agile QA-RM

• Model checked against similar models and agile methodologies.

• Evaluated by expert opinion.– 5 experts– Main suggestions concerned• Description of levels, purpose, and expected results of

process areas, to adjust with other models• Application of process areas through agile practices,

approaching it to agile development.

31

Road Map

• Introduction• Agile and CMMI• Current Models• Agile QA-RM• Evaluation of Agile QA-RM• Conclusions

32

Conclusions

• Model has not been used in industry.• More expert evaluation needed. • Agile will continue to change.

33

Conclusions

• Questions and feedback