data collection and analysis for better requirements

42
BW6 Concurrent Session 11/13/2013 2:15 PM "Data Collection and Analysis for Better Requirements" Presented by: Brandon Carlson Lean TECHniques, Inc. Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888Ͳ268Ͳ8770 ͼ 904Ͳ278Ͳ0524 ͼ [email protected] ͼ www.sqe.com

Upload: techwellpresentations

Post on 04-Dec-2014

118 views

Category:

Technology


2 download

DESCRIPTION

According to studies, 64 percent of features in systems are rarely—or never—used. How does this happen? Today, the work of eliciting the customers' true needs, which often remains elusive, can be enhanced using data-driven requirements techniques. Brandon Carlson describes why traditional requirements analysis is so difficult and presents a set of seven data collection approaches and analysis techniques you can employ on your projects right away. Learn how to instrument existing applications and develop new requirements based on operational profiles of the current system. Learn to use A/B testing—a technique for trying out and analyzing alternative implementations—on your current system to determine which new features will deliver the most business value. With these tools at hand, you can help users and business stakeholders decide the best approaches and new features to meet their real needs. Now is the time to take the guesswork out of requirements and get the facts.

TRANSCRIPT

Page 1: Data Collection and Analysis for Better Requirements

BW6 Concurrent�Session�11/13/2013�2:15�PM�

������

"Data Collection and Analysis for Better Requirements"

���

Presented by:

Brandon Carlson Lean TECHniques, Inc.

��������

Brought�to�you�by:��

��

340�Corporate�Way,�Suite�300,�Orange�Park,�FL�32073�888Ͳ268Ͳ8770�ͼ�904Ͳ278Ͳ0524�ͼ�[email protected]�ͼ�www.sqe.com

Page 2: Data Collection and Analysis for Better Requirements

Brandon Carlson Lean TECHniques, Inc.

A self-proclaimed nerd, Brandon Carlson works for Lean TECHniques, Inc., an IT consultancy that helps teams deliver high-value, high-quality products to market. Since starting his career in 1995, Brandon has held positions from development and architecture to management—and he’s still learning. Passionate about elevating the performance of IT as a whole, he has helped numerous organizations from startups to Fortune 100 companies improve their product development and delivery systems. Brandon’s current interests include data-driven product definition/development and professionalism in the world of software development. He can be reached on Twitter and pretty much everywhere else on the web as “bcarlso.” Read his blog at bcarlso.net/.

Page 3: Data Collection and Analysis for Better Requirements

Just The Facts Ma’amData Collection and Analysis for Better

Products

Page 4: Data Collection and Analysis for Better Requirements

About Me

Brandon Carlson

Lean TECHniques, Inc.

[email protected]

On the web: ‘bcarlso’

Page 5: Data Collection and Analysis for Better Requirements

Required Reading

Page 6: Data Collection and Analysis for Better Requirements

Theory of Constraints

1525 20 2510

Page 7: Data Collection and Analysis for Better Requirements

Theory of Constraints

1525 20 2510

Page 8: Data Collection and Analysis for Better Requirements

Theory of Constraints

1525 20 2510

Page 9: Data Collection and Analysis for Better Requirements

Agile: IT as Constraint

MarketingSales Operations CustomerIT

Page 10: Data Collection and Analysis for Better Requirements

Lean: Optimize the Whole

MarketingSales Operations CustomerIT

Page 11: Data Collection and Analysis for Better Requirements

A Turning Point

Page 12: Data Collection and Analysis for Better Requirements

“Our highest priority is to satisfy the customerthrough early and continuous delivery

of valuable software.”

Page 13: Data Collection and Analysis for Better Requirements

“Our highest priority is to satisfy the customerthrough early and continuous delivery

of valuable software.”

Page 14: Data Collection and Analysis for Better Requirements

Information as Constraint

MarketingSales Operations CustomerIT

Page 15: Data Collection and Analysis for Better Requirements

MarketingSales Operations CustomerITInformation

Page 16: Data Collection and Analysis for Better Requirements

MarketingSales Operations CustomerIT

Missing Feedback Loops?

Page 17: Data Collection and Analysis for Better Requirements

What we (don’t) know...

http://ww

w.flickr.com

/photos/flamephoenix1991/8376271918/sizes/m

/

Page 18: Data Collection and Analysis for Better Requirements

Law Of Small Numbers

http://ww

w.flickr.com

/photos/wfryer/8166990403/

Page 19: Data Collection and Analysis for Better Requirements

Confirmation Bias

http://ww

w.geograph.org.uk/photo/35330

Page 20: Data Collection and Analysis for Better Requirements

WYSIATI

http://ww

w.flickr.com

/photos/3059349393/8000156483/

Page 21: Data Collection and Analysis for Better Requirements

Availability Bias

http://no.wikipedia.org/w

iki/Fil:Rottw

eiler_standing_facing_left.jpghttp://com

mons.w

ikimedia.org/w

iki/File:Germ

an_Shepherd_Dog_w

ith_disc.jpg

Page 22: Data Collection and Analysis for Better Requirements

Response Bias

http://farm4.staticflickr.com

/3444/3392536961_8b9aae5f6b_o.jpg

Page 23: Data Collection and Analysis for Better Requirements

Preference Theory

http://ww

w.flickr.com

/photos/sis/200768094/sizes/m/in/photostream

/

Page 24: Data Collection and Analysis for Better Requirements

Social Norms

http://comm

ons.wikim

edia.org/wiki/File:Facebook_like_thum

b.png

Page 25: Data Collection and Analysis for Better Requirements

7 SpotlightsSeven factabulous ways to get better

requirements

http://ww

w.flickr.com

/photos/enricomaritano/4210706861

Page 26: Data Collection and Analysis for Better Requirements

Traffic Analysis�

http://ww

w.flickr.com

/photos/14954127@N00/4546555910

Page 27: Data Collection and Analysis for Better Requirements

Observe First

�Stalking > Talking

Page 28: Data Collection and Analysis for Better Requirements

Leverage Development

log(sha1(currentUser, deviceId));

Page 29: Data Collection and Analysis for Better Requirements

Leverage Development

results = performSearch(searchString)

if results.empty?

log(“empty.search”, searchString)

end

Page 30: Data Collection and Analysis for Better Requirements

Enterprise Anthropology�

http://ww

w.flickr.com

/photos/ricardoalvarez/162914130/

Page 31: Data Collection and Analysis for Better Requirements

A/B TestChoose between

two options

http://ww

w.flickr.com

/photos/donkeyhotey/5731191759

Page 32: Data Collection and Analysis for Better Requirements

Restrict Access�

http://ww

w.flickr.com

/photos/harvypascua/46114061

Page 33: Data Collection and Analysis for Better Requirements

Play the Nickel Slotsaka Little Bets

http://ww

w.flickr.com

/photos/orphanjones/2370564178

Page 34: Data Collection and Analysis for Better Requirements

7 Spotlights

• Traffic Analysis

• Observe First

• Leverage Development

• Enterprise Anthropology

• A/B Test

• Restrict Access

• Nickel Slots

Page 35: Data Collection and Analysis for Better Requirements

7 Spotlights• Traffic Analysis

• Observe First

• Leverage Development

• Enterprise Anthropology

• A/B Test

• Restrict Access

• Nickel Slots

Page 36: Data Collection and Analysis for Better Requirements

Use the 7 Spotlights to get the facts about what

your customers do...

Page 37: Data Collection and Analysis for Better Requirements

...then combine that with what they say

Page 38: Data Collection and Analysis for Better Requirements

...to help you eliminate waste and discover the

right product.

Page 39: Data Collection and Analysis for Better Requirements

The “Right” Product

• Reduced Market Risk

• Increased Customer Understanding

• “Good enough” Features

• Higher ROI

• Tactical Agility

Page 40: Data Collection and Analysis for Better Requirements

The “Right” Product

• Reduced Market Risk

• Increased Customer Understanding

• “Good Enough” Features

• Higher ROI

• Tactical Agility

Page 42: Data Collection and Analysis for Better Requirements

[email protected]

@bcarlso