Agility Measurement: In Quest of Gold Standard Oleksandr Zhebryakov & Vadim Izdebskiy

2

• Ciklum — Own Development Centers for client’s growth

○ 2500 IT Specialists○ 200+ Clients

• 80% of our customers use Agile

* Context: Ciklum

3

* Common questions we hear:

• What other clients do to be successful?• Where am I, compared to other clients?

4

• Nearshore team is getting up-to-speed• Onshore and Nearshore teams

alignment• Periodically analyze improvement and

compliance to Agile practices

* Client needs

• Adopt Agile• Periodically analyze

improvement

Already Agile1 Agile wannabees2

5

* In search of an agilitymeasurement system • Mike Cohn’s “Comparative Agility™”:

• Online Survey• Compare yourself to other survey participants

• Five-point Likert scale:• True• More true than false• Neither true nor false• More false than true• False

• Seven dimensions:• Teamwork• Requirements• Planning• Technical practices• Quality• Culture• Knowledge creation

6

Why?

• Quality of data• Own set of questions• Flexibility of own platform

* CAMS: Ciklum way

7

• 15 pilot teams• Individual interviews

* CAMS: Inception

• People are subjective• Questions are interpreted in a

different way

How it was: Findings:

8

* CAMS: Maturing• Face-to-face facilitated group

workshops• “Planning poker”-like voting• 85 teams• Data slicing

9

• Big effort

* CAMS: Findings

• High quality data • Small volumeof data

• Apples to apples comparison

5

10

• Compliance to Agile practices

• Comparison of 7 teams

* CAMS: Results

• QA integration in Agile teams

• Define Site Manager’s role in Agile

• Compliance of Malta teams to Agile practices

• Plan for Ukrainian teams kick-off

Payment system Media company Apps development company

11

12

* Process Compliance Approach

• Agility compliance tool• Tool for assessment at team

level• Root cause analysis

Examples:CAMS or Comparative Agility™

13

* Performance MeasurementApproach

• Tool for the delivery performance measurement

• Good to identify symptoms

Source: Rally Software Development Corp.

Example: Rally Insights™

14

• Effortless

* Rally Insights™

• High data quality • Large volume of data

• Apples to oranges comparison

Use during process assessment and solution mapping

• How my teams compare to each other and to teams within other companies with regards to processes?

• Are we improving our Agile process?

• What is a root-cause of a particular symptom of bad delivery?

* Two approaches: how and when?

Regular usage

• Do we meet goals for s/w delivery?

• Are we improving our performance and quality?

• How our delivery performance compares to others?

Performance Measurement Process Compliance

15

16

FREE HUGS

* Thanks for your time!