no estimates - a controversial way to improve estimation with results-handouts
DESCRIPTION
Often we hear that estimating a project is a must. "We can't make decisions without them" we hear often. In this session I'll present examples of how we can predict a release date of a project without any estimates, only relying on easily available data. I'll show how we can follow progress on a project at all times without having to rely on guesswork, and we will review how large, very large and small projects have already benefited from this in the past. At the end of the session you will be ready to start your own #NoEstimates journey.TRANSCRIPT
![Page 1: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/1.jpg)
#NoEstimates
Vasco Duarte@duarte_vasco
A way to improve estimates that gives you results!
![Page 2: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/2.jpg)
Learn more about NoEstimates:
• How it can help you turn around a failing project
• How it can help you show what is possible and stick to that
• How it can help you find very early if you are late (and get your manager, or customer, to believe you)
• How to apply #NoEstimates without threatening anyone
Become a Beta Reader and get the book for free!
http://NoEstimatesBook.com
![Page 3: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/3.jpg)
Vasco Duarte@duarte_vasco
http://bit.ly/vasco_blog
http://bit.ly/vasco_slideshare
http://NoEstimatesBook.com
![Page 4: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/4.jpg)
![Page 5: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/5.jpg)
![Page 6: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/6.jpg)
![Page 7: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/7.jpg)
![Page 8: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/8.jpg)
![Page 9: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/9.jpg)
#NoEstimates
![Page 10: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/10.jpg)
![Page 11: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/11.jpg)
pictoquotes
![Page 12: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/12.jpg)
Kent Beck – Extreme Programming
![Page 13: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/13.jpg)
Ken Schwaber - Scrum
![Page 14: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/14.jpg)
Taiichi Ohno – Toyota Production System
![Page 15: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/15.jpg)
Edwards W. Deming – Everything above...
![Page 16: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/16.jpg)
“If I have seen further it is by standing on the shoulders of giants” - Isaac Newton
![Page 17: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/17.jpg)
![Page 18: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/18.jpg)
![Page 19: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/19.jpg)
![Page 20: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/20.jpg)
![Page 21: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/21.jpg)
Just Google
it
![Page 22: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/22.jpg)
![Page 23: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/23.jpg)
Customer Collaboration over Contract NegotiationResponding to Change over Following a Plan
![Page 24: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/24.jpg)
![Page 25: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/25.jpg)
![Page 26: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/26.jpg)
#NoEstimates is easy!
![Page 27: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/27.jpg)
1.Select the most important piece of work you need to do
2.Break that work down into risk-neutral chunks of work
3.Develop each piece of work4.Iterate and refactor
#NoEstimates How-to
![Page 28: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/28.jpg)
Is the system of development stable?
(ref: SPC)
![Page 29: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/29.jpg)
I AM GOING TO GO AHEAD AND
ASK YOU TO DELIVER 10
STORIES NEXT SPRINT...
![Page 30: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/30.jpg)
0
1
2
3
4
5
6
7
8
9
10
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21
velocity
Average=
LCL
UCL
Target
Actual, measured throughput over 21 sprints
![Page 31: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/31.jpg)
WTF!!!!!!#%&!
![Page 32: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/32.jpg)
Can we use the data we observe to predict the system throughput and detect changes that affect system
stability?
![Page 33: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/33.jpg)
1.Velocity outside limits 3 times in a row (“outside limits”)
2.There are 5 or more points in sequence (“run test”)
System stability rules
More in the 1-day #NoEstimates WorkshopInformation by email: [email protected]
![Page 34: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/34.jpg)
0
2
4
6
8
10
12
1 3 5 7 9 11 13 15 17 19 21
# of items/storiesdelivered
LCL
UCL
average
Team: AT
0
2
4
6
8
10
12
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
LCL
UCL
average
# of items/storiesdelivered
Team: RF
0
2
4
6
8
10
12
14
16
18
20
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17
LCL
UCL
average
# of items/storiesdelivered
Team: RF2
0
5
10
15
20
25
1 3 5 7 9 11 13 15 17 19 21
# of items/storiesdelivered
LCL
UCL
average
Team: SH
![Page 35: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/35.jpg)
-1
1
3
5
7
9
11
13
15
17
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35
LCL
UCL
average
# of items/storiesdelivered
Team: K
0
2
4
6
8
10
12
14
16
1 2 3 4 5 6 7 8
# of items/storiesdelivered
LCL
UCL
average
Team: MPC
0
2
4
6
8
10
12
14
16
1 2 3 4 5 6 7 8 9 1011121314151617181920
# of items/storiesdelivered
LCL
UCL
average
Team: AS
0
5
10
15
20
25
30
1 2 3 4 5 6 7 8 9 10
# of items/storiesdelivered
LCL
UCL
average
Team: FC
![Page 36: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/36.jpg)
#NoEstimates delivers!
![Page 37: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/37.jpg)
Counting Stories vs. Estimated Story Points
Q: Which ”metric” is more accurate when compared to
what actually happened in the project?
![Page 38: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/38.jpg)
A long project
24Sprints
![Page 39: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/39.jpg)
Which metric predicted most accurately the output of the
whole project?
a) After only the first 3 Sprints
b) After only the first 5 Sprints
![Page 40: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/40.jpg)
Disclaimer...This is only one project!
Find 21 more at: http://bit.ly/NoEstimatesProjectsDB
![Page 41: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/41.jpg)
After just 3 sprints
# of Stories predictive powerStory Points predictive power
The true output: 349,5 SPs
completed
The predictedoutput: 418 SPs
completed
+20%
The true output: 228 Stories
The predictedoutput: 220
Stories
-4%!
![Page 42: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/42.jpg)
After just 5 sprints
# of Stories predictive powerStory Points predictive power
The true output: 349,5 SPs
completed
The predictedoutput: 396 SPs
completed
+13%
The true output: 228 Stories
The predictedoutput: 220
Stories
-4%!
![Page 43: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/43.jpg)
Q: Which ”metric” is more accurate when compared to
what actually happened in the project?
![Page 44: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/44.jpg)
But there is more...
![Page 45: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/45.jpg)
![Page 46: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/46.jpg)
#NoEstimates
RegularEstimates
“The chart is a snapshot of one team of 20+ teams over a 2 year period.” – Cory Foy
![Page 47: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/47.jpg)
Which is more
predictable?
![Page 48: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/48.jpg)
What difference does a Story Point make in a project that used both Story Points and
#NoEstimates?
![Page 49: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/49.jpg)
Next you will see the forecasted release date when
using Story Points (values 1:3:5)
![Page 50: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/50.jpg)
6871 71 71 71 71 71 72 72 72 73 73
0 3 7 7 9 11 12 13
20 20 22 23
0
10
20
30
40
50
60
70
80
90
100
1/3 1/17 1/31 2/14 2/28 3/14 3/28 4/11 4/25 5/9 5/23 6/6 6/20 7/4 7/18 8/1 8/15 8/29 9/12 9/26 10/10 10/24 11/7
Product Backlog Cumulative Flow Diagram
Remaining
Done
Linear (Remaining)
Linear (Done)
Release on 20th October
2014
![Page 51: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/51.jpg)
Next you will see the forecasted release date when
using Story Points (values 1:2:3)
![Page 52: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/52.jpg)
48
51 51 51 51 51 51 52 52 52 53 53
0 2 5 5 7 8 9 1015 15 17 18
0
10
20
30
40
50
60
70
80
1/3 1/17 1/31 2/14 2/28 3/14 3/28 4/11 4/25 5/9 5/23 6/6 6/20 7/4 7/18 8/1 8/15 8/29 9/12 9/26 10/10 10/24 11/7
Product Backlog Cumulative Flow Diagram
Remaining
Done
Linear (Remaining)
Linear (Done)Release on
14th October 2014
![Page 53: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/53.jpg)
Next you will see the forecasted release date when
#NoEstimates (or, all stories = 1 story point)
![Page 54: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/54.jpg)
28
31 31 31 31 31 3132 32 32
33 33
0 1 3 35 5 6 7
10 1012 13
0
10
20
30
40
50
60
1/3 1/17 1/31 2/14 2/28 3/14 3/28 4/11 4/25 5/9 5/23 6/6 6/20 7/4 7/18 8/1 8/15 8/29 9/12 9/26 10/10 10/24 11/7
Product Backlog Cumulative Flow Diagram
Remaining
Done
Linear (Remaining)
Linear (Done)
Release on 29thSeptember 2014
![Page 55: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/55.jpg)
Conclusion...
![Page 56: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/56.jpg)
All dates within 3 weeks of each other in a 38 to 42 week
project (a margin of ~8%)
![Page 57: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/57.jpg)
Data used with permission from Bill Hanlon at Microsoft
”At that point, I stopped thinking that estimating
was important.”
Bill Hanlon: http://bit.ly/BHanlon
![Page 58: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/58.jpg)
In 1986, Profs. S.D. Conte, H.E. Dunsmoir, andV.Y. Shen proposed that a good estimationapproach should provide estimates that arewithin 25% of the actual results 75% of the time
--Steve McConnel, Software Estimation: Demystifying the Black Art
In this presentation you have seen examples that far outperform what estimation specialists consider a ”good estimation”. In common they have one way to look at work: #NoEstimates
![Page 59: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/59.jpg)
#NoEstimates testimonial
The deviation between estimated and actual velocity would have been approximately 15% lower if we would have used #NoEstimates.
We have analyzed data from 50 Sprints…
…at no time the story point based estimation was better than #NoEstimates.
![Page 60: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/60.jpg)
One more thing...
![Page 61: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/61.jpg)
80% Late or Failed
Source: Software Estimation by Steve McConnell
![Page 62: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/62.jpg)
The larger the project, the bigger the problem
Source: Software Estimation by Steve McConnell
![Page 63: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/63.jpg)
Source: Software Estimation by Steve McConnell
![Page 64: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/64.jpg)
Comparison of 17 projects ending between 2001 and 2003. (Average: 62%)
![Page 65: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/65.jpg)
![Page 66: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/66.jpg)
![Page 67: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/67.jpg)
Take #NoEstimates and experiment!
Learn, Be Agile!
![Page 68: No estimates - a controversial way to improve estimation with results-handouts](https://reader035.vdocuments.us/reader035/viewer/2022081401/559441861a28ab04258b45d7/html5/thumbnails/68.jpg)
Learn more about NoEstimates:
• How it can help you turn around a failing project
• How it can help you show what is possible and stick to that
• How it can help you find very early if you are late (and get your manager, or customer, to believe you)
• How to apply #NoEstimates without threatening anyone
http://NoEstimatesBook.com
Become a Beta Reader and get the book for free!