20150409 nuvention analytics
TRANSCRIPT
@deanmalmgren @DsAtweet
2015 april 9 nuvention analytics
solve for ambiguityadapting the design process for analytics problems
data scientists thrive with ambiguitysolve for x
x = 5 + 2
proj
ect e
volu
tion
A x = b optimize f(x)
optimize A x = b
subject to f(x) > 0
optimize “our profitability”
@deanmalmgren | bit.ly/design-data
origins of ambiguitymany feasible approaches
@deanmalmgren | bit.ly/design-data
origins of ambiguityunclear problems
@deanmalmgren | bit.ly/design-data
identify the best locations to plant new trees
origins of ambiguityunclear problems
@deanmalmgren | bit.ly/design-data
identify the best locations to plant new treeshow many?
what kinds of trees? move old trees?
replace old trees?
origins of ambiguityunclear problems
identify the best locations to plant new treeshow many?
what kinds of trees? move old trees?
replace old trees?
aesthetically pleasing? maximize growth? increase foliage? offset CO2 emissions?
@deanmalmgren | bit.ly/design-data
@deanmalmgren | bit.ly/design-data
generate hypotheses
build prototype
evaluate feedback
surveys, interviews, focus groups split testing, A/B testing QA; requirements churn
personas, scenarios, use cases business/product requirements story/user cards
build device prototypes minimum viable product write code
human-centered design lean startup agile programming
“design process” is used everywhereanticipate failure
1-4 week iterations
data-driven e-discoverydaegis
@deanmalmgren | bit.ly/design-data
data-driven e-discoverydaegis
abou
t pat
ent
not
abou
t pat
ent
@deanmalmgren | bit.ly/design-data
daegis
abou
t pat
ent
not
abou
t pat
ent
turn over to plaintiffdon’t
turn over to plaintiff
adverse inference
data-driven e-discovery
@deanmalmgren | bit.ly/design-data
daegis
abou
t pat
ent
not
abou
t pat
ent
turn over to plaintiffdon’t
turn over to plaintiff
adverse inference
give away trade secrets
data-driven e-discovery
@deanmalmgren | bit.ly/design-data
daegis
abou
t pat
ent
not
abou
t pat
ent
turn over to plaintiffdon’t
turn over to plaintiff
adverse inference
give away trade secrets
data-driven e-discovery
@deanmalmgren | bit.ly/design-data
daegis
turn over to plaintiffdon’t
turn over to plaintiff
data-driven e-discovery
@deanmalmgren | bit.ly/design-data
daegisdata-driven e-discovery
@deanmalmgren | bit.ly/design-data
daegis
create a “document map”
algorithm design
patents
marketing
finances
fantasy footballlunch
coffee
data-driven e-discovery
@deanmalmgren | bit.ly/design-data
daegis
create a “document map”
fantasy football
algorithm design
patents
lunch
marketing
finances
coffee
review away shades of grey
reduce reviews by 90-99%
data-driven e-discovery
@deanmalmgren | bit.ly/design-data
daegisdata-driven e-discovery
@deanmalmgren | bit.ly/design-data
motorola
new product announcement
first versions from manufacturer
available in stores
next generation to manufacturer
product defects from consumers
@deanmalmgren | bit.ly/design-data
data-driven consumer feedback
motorola
@deanmalmgren | bit.ly/design-data
data-driven consumer feedback
motorola
@deanmalmgren | bit.ly/design-data
data-driven consumer feedback
@deanmalmgren | bit.ly/design-data
generate hypotheses
build prototype
evaluate feedback
proof is in the pudding
problem lost in translation
takes a long time to collect data, analyze, and build visualization
design and data sciencechallenges in practice
1-4 week iterations
@deanmalmgren | bit.ly/design-data
a project always starts with…
@deanmalmgren | bit.ly/design-data
informal conversation to stated goalsmostly bad ideas, but a few good ones
@deanmalmgren | bit.ly/design-data
mostly bad ideas, but a few good ones
Lorem Ipsum: a narrative about blankets.
Author: Charlie Brown
Date: 31 Jan 2012
Lorem Ipsum is a dummy text used when typesetting or marking up documents. It has a long history starting from the 1500s and is still used in digital millennium for typesetting electronic documents, page designs, etc.
In itself, the original text of Lorem Ipsum might have been taken from an ancient Latin book that was written about 50 BC. Nevertheless, Lorem Ipsum’s words have been changed so they don’t read as a proper text.
Naturally, page designs that are made for text documents must contain some text rather than placeholder dots or something else. However, should they contain proper English words and sentences almost every reader will deliberately try to interpret it eventually, missing the design itself.
However, a placeholder text must have a natural distribution of letters and punctuation or otherwise the markup will look strange and unnatural. That’s what Lorem Ipsum helps to achieve.
I would like to thank Peppermint Patty for her support on studying
Lorem Ipsum as well as the infinite wisdom of Linus van Pelt and his willingness to use his blanket in my experiments.
informal conversation to stated goals
@deanmalmgren | bit.ly/design-data
mostly bad ideas, but a few good onesinformal conversation to stated goals
now what?
@deanmalmgren | bit.ly/design-data
concept sketch comparisonsqualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisonsqualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisonsqualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisonsqualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisonsqualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisonsqualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisonsqualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisonsqualitative a/b testing
search engine with relevance metrics
demographics human readable expertise summary
now what?
@deanmalmgren | bit.ly/design-data
from sketch to blue printadd detail to get feedback (while building)
@deanmalmgren | bit.ly/design-data
from sketch to blue printadd detail to get feedback (while building)
@deanmalmgren | bit.ly/design-data
from sketch to blue printadd detail to get feedback (while building)
@deanmalmgren | bit.ly/design-data
prototype iterationsfaux first; KISS; build for feedback
@deanmalmgren | bit.ly/design-data
generate hypotheses
build prototype
evaluate feedback
proof is in the pudding
problem lost in translation
takes a long time to collect data, analyze, and build visualization
tips for designing with data
1-4 week iterations
http://bit.ly/design-data
@deanmalmgren [email protected]
solve ambiguous problems with an iterative approach