experimentation mindset
TRANSCRIPT
#adchi / #ExperimentationMindset / @DocOnDev
The Experimentation Mindset
#adchi / #ExperimentationMindset / @DocOnDev
Doc Norton, CEO
@DocOnDev
@adchi / #ExperimentationMindset / @DocOnDev
#adchi / #ExperimentationMindset / @DocOnDev
Mindset
#adchi / #ExperimentationMindset / @DocOnDev
A simple experiment
#adchi / #ExperimentationMindset / @DocOnDev
Two Groups
#adchi / #ExperimentationMindset / @DocOnDev
Small Difference; Big Result
#adchi / #ExperimentationMindset / @DocOnDev
Mindset
the ideas and attitudes with which a person approaches a situation
#adchi / #ExperimentationMindset / @DocOnDev
fixed growth
#adchi / #ExperimentationMindset / @DocOnDev
Dreyfus Model of skills acquisition
#adchi / #ExperimentationMindset / @DocOnDev
Novice
#adchi / #ExperimentationMindset / @DocOnDev
Advanced Beginner
#adchi / #ExperimentationMindset / @DocOnDev
Competent
#adchi / #ExperimentationMindset / @DocOnDev
Proficient
#adchi / #ExperimentationMindset / @DocOnDev
Expert
#adchi / #ExperimentationMindset / @DocOnDev
Where are you?
#adchi / #ExperimentationMindset / @DocOnDev
Most think they’re Expert
#adchi / #ExperimentationMindset / @DocOnDev
most stay at Proficient
#adchi / #ExperimentationMindset / @DocOnDev
From Implementation
#adchi / #ExperimentationMindset / @DocOnDev
Implementation Mindset get it right
A+
#adchi / #ExperimentationMindset / @DocOnDev
to experimentation
#adchi / #ExperimentationMindset / @DocOnDev
experimentation Mindset explore different ways
#adchi / #ExperimentationMindset / @DocOnDev
experimentation Mindset explore different ways
#adchi / #ExperimentationMindset / @DocOnDev
but in a typical company…
#adchi / #ExperimentationMindset / @DocOnDev
telephone sales
#adchi / #ExperimentationMindset / @DocOnDev
Follow the script
This will
be
great!
#adchi / #ExperimentationMindset / @DocOnDev
It wasn’t Great
Ptolemy Janet Raphael Susan Kathy Tommy Doc Chris P.
Weekly Sales Rankings
#adchi / #ExperimentationMindset / @DocOnDev
Watch The Mastermy name is ____________________ …Hello (sir/madam),
#adchi / #ExperimentationMindset / @DocOnDev
Watch The Mastermy name is ____________________ …Pat MichaelsGood Day!
#adchi / #ExperimentationMindset / @DocOnDev
Experiment
#adchi / #ExperimentationMindset / @DocOnDev
experiment
#adchi / #ExperimentationMindset / @DocOnDev
experiment
#adchi / #ExperimentationMindset / @DocOnDev
experiment
#adchi / #ExperimentationMindset / @DocOnDev
top in sales!
Doc Ptolemy Janet Kathy Tommy Raphael Susan Andy
Weekly Sales Rankings
#adchi / #ExperimentationMindset / @DocOnDev
8 week review
#adchi / #ExperimentationMindset / @DocOnDevnot the feedback I expected
#adchi / #ExperimentationMindset / @DocOnDev
My last day
#adchi / #ExperimentationMindset / @DocOnDev
Best Practices
#adchi / #ExperimentationMindset / @DocOnDev
Implementation Mindset get it right
A+
#adchi / #ExperimentationMindset / @DocOnDev
Single Loop
Assumptions Actions Outcomes
Get it Right
#adchi / #ExperimentationMindset / @DocOnDev
The Dark Side
#adchi / #ExperimentationMindset / @DocOnDev
double Loop
Assumptions Actions Outcomes
Get it Right
Explore Different Ways
#adchi / #ExperimentationMindset / @DocOnDev
best practices
#adchi / #ExperimentationMindset / @DocOnDev
leading practices
#adchi / #ExperimentationMindset / @DocOnDev
from implementation to experimentation
#adchi / #ExperimentationMindset / @DocOnDev
experimentation
#adchi / #ExperimentationMindset / @DocOnDev
experimentation
#adchi / #ExperimentationMindset / @DocOnDev
split (a/B) + Multivariate
#adchi / #ExperimentationMindset / @DocOnDev
Cumulative Flow
#adchi / #ExperimentationMindset / @DocOnDev
velocity trends
#adchi / #ExperimentationMindset / @DocOnDev
code quality
#adchi / #ExperimentationMindset / @DocOnDev
employee engagement
#adchi / #ExperimentationMindset / @DocOnDev
team joy
#adchi / #ExperimentationMindset / @DocOnDev
Retrospectives
#adchi / #ExperimentationMindset / @DocOnDev
refine their process
#adchi / #ExperimentationMindset / @DocOnDev
Orientation + On-Boarding
#adchi / #ExperimentationMindset / @DocOnDev
Interest Leagues
#adchi / #ExperimentationMindset / @DocOnDev
hackathons
#adchi / #ExperimentationMindset / @DocOnDev
mentorships
#adchi / #ExperimentationMindset / @DocOnDev
360 / peer reviews
#adchi / #ExperimentationMindset / @DocOnDev
managers institutionalize procedure
- Gabe Newell
#adchi / #ExperimentationMindset / @DocOnDev
being open about [pay] breeds trust
- Leo Widrich
#adchi / #ExperimentationMindset / @DocOnDev
managers [are] mentors- Kevin Goldsmith
#adchi / #ExperimentationMindset / @DocOnDev
four things
#adchi / #ExperimentationMindset / @DocOnDev
know your purpose; challenge assumptions
#adchi / #ExperimentationMindset / @DocOnDev
make failure acceptable
– Henry Ford
“Failure is simply the opportunity to begin again, this time more intelligently.”
think big… start small… .
#adchi / #ExperimentationMindset / @DocOnDev
be intolerant of mediocrity
#adchi / #ExperimentationMindset / @DocOnDev
keep experimenting
Assumptions Actions Outcomes
Get it Right
Explore Different Ways
Thank You!
#adchi / #ExperimentationMindset / @DocOnDev
The Experimentation Mindset
#adchi / #ExperimentationMindset / @DocOnDev
• Mad Scientist - https://www.flickr.com/photos/dzingeek/4587871752/sizes/o/
• Stages of Growth - http://superkoopatroopa.deviantart.com/art/Terri-Growth-chart-125875917
• Elephant and Mother - http://upload.wikimedia.org/wikipedia/commons/7/75/Baby_asian_elephant_(with_his_mother)_born_in_the_Lao_Elephant_Conservation_Center_in_Sayaboury.jpg Phone Script - http://www.docstoc.com/docs/6629075/Sample-Sales-Script
• Phones -
• http://www.enumclawsda.org/uploads/1/3/3/9/13391741/1971539_orig.gif?119
• http://4.bp.blogspot.com/-qASUt2T7C7o/ULvJ8HVU3LI/AAAAAAAAACw/LufW5HYhCyM/s1600/Tel%C3%A8fon+fixe+antic.png
• https://c2.staticflickr.com/8/7443/8758001086_2692f91620_h.jpg
• http://cdn2.hubspot.net/hub/147894/file-270530761-jpg/images/phone-large.jpg
• Mob Programming - https://techblog.betclicgroup.com/wp-content/uploads/2014/09/mob-programming-1-1024.jpg
• Spotify Matrix - http://blog.kevingoldsmith.com/wp-content/uploads/2014/03/Screen-Shot-2013-11-09-at-7.30.08-AM-1024x644.png
• a/b | multivariate testing - https://www.dynamicyield.com/wp-content/uploads/2014/05/testing.jpg
• Hackathon - https://m2.behance.net/rendition/pm/22070355/disp/f4d62818fcb09d43722a945486ca5300.png
• Things - http://41.media.tumblr.com/d721f204c69de1b5a6a4899429430c9e/tumblr_n52o0matip1snioclo1_1280.jpg, http://cdn.instructables.com/FIT/POMF/HKJTCKRQ/FITPOMFHKJTCKRQ.LARGE.jpg, http://shadowgrail.deviantart.com/art/Rock-of-Ages-83993992, http://vo5.deviantart.com/art/Fantastic-Four-163610854
Images
#adchi / #ExperimentationMindset / @DocOnDev
• Students Test - https://img.washingtonpost.com/rf/image_1484w/2010-2019/WashingtonPost/2014/09/17/Others/Images/2014-09-17/DSC_54171410973389.jpg?uuid=h6VsJD6MEeSkMLgqPme3Yg
• Woody Zuill - https://pbs.twimg.com/media/A8NKQ9lCQAAdA7h.jpg
• Code Quality (WTF) - http://www.sonarqube.org/wp-content/uploads/2009/09/wtfm.jpg
• 360 Feedback - http://screencrush.com/442/files/2012/07/360-review.jpg
• Test Tube - http://fc09.deviantart.net/fs70/i/2010/018/2/1/Vector_Test_Tube_by_Algerianoo.jpg
• No Estimates - https://twitter.com/NoEstimates
• Tesla - https://c2.staticflickr.com/4/3006/2932363100_5bf7ff5820_b.jpg
• Smiley - https://blogs.dal.ca/csc/files/2012/07/MP900443129.jpg
• Dilbert - http://www.stephenshapiro.com/images/dilbert-bp.gif
• Manager’s Office - https://www.flickr.com/photos/islespunkfan/8281372547/sizes/l
• Bad review - http://media.benefitspro.com/benefitspro/article/2014/02/06/negative%20reviews.jpg
• Captain my Captain - http://startupeers.co/wp-content/uploads/2014/08/o-captain-e1407919367905.jpg
• Vader in Suit - http://fc06.deviantart.net/fs71/f/2011/179/a/a/darth_vader_by_iamthedarthvader-d3k9n2h.jpg
• League - https://oliverwillis.com/wp-content/uploads/2015/08/league-of-legends.jpg
• Mentorship - http://humancapitalist.com/wordpress/wp-content/uploads/2013/11/canstockphoto15167410.jpg
more images
#adchi / #ExperimentationMindset / @DocOnDev
• Dreyfus Model of Skills Acquisition - http://en.wikipedia.org/wiki/Dreyfus_model_of_skill_acquisition, http://files.eric.ed.gov/fulltext/ED384695.pdf#page=130, https://www.dropbox.com/s/px1d5orrtjm5d5i/ADA084551.pdf?dl=0
• Learning through experimentation - http://lifehacker.com/5985565/how-and-why-to-intentionally-set-yourself-up-for-failure
• HBR: Collective Genius - http://hbr.org/2014/06/collective-genius/ar/1
• How Organizations Learn - http://www.areteadventures.com/articles/the_challenge_of_entering_the_green_room.pdf
• Argyris: Teaching Smart People how to Learn - http://hbr.org/1991/05/teaching-smart-people-how-to-learn/ar/1, http://pds8.egloos.com/pds/200805/20/87/chris_argyris_learning.pdf
• Argyris: Double Loop Learning in Organizations - http://hbr.org/1977/09/double-loop-learning-in-organizations/ar/3
• A/B Testing and the Experimentation Culture - https://hbr.org/2014/02/ab-testing-and-the-benefits-of-an-experimentation-culture/
• Enlightened Experimentation - https://hbr.org/2001/02/enlightened-experimentation-the-new-imperative-for-innovation/ar/4
• Argyris: Single-Loop and Double-Loop Learning in Research on Decision Making - https://093#1c5e28761e25b79cfc10de03f5a188778a0.googledrive.com/host/0B_RO2ClD0V7AZHpWRS1mNUc2d1k/argyris.pdf
• Ed Batista Blog - http://www.edbatista.com/2008/05/double-loop.html
Reference Material
#adchi / #ExperimentationMindset / @DocOnDev
• Lean Change - http://www.lean.org/LeanPost/Posting.cfm?LeanPostId=225
• Scaling Up Excellence - http://www.amazon.com/Scaling-up-Excellence-Hayagreeva-Rao-ebook/dp/B00EGMQIDG
• Start With Why - http://www.amazon.com/Start-Why-Leaders-Inspire-Everyone-ebook/dp/B002Q6XUE4/
• Leading Change - http://www.amazon.com/gp/product/0875847471/
• Woody Zuill - https://twitter.com/woodyzuill, http://zuill.us/WoodyZuill/
• Mob Programming and No Estimates - http://www.infoq.com/interviews/zuill-mob-programming
• Democratizing Experimentation - https://hbr.org/2011/04/8-ways-to-democratize-experime/
• Failing by Design - https://hbr.org/2011/04/failing-by-design/ar/1
• Smart Business Experiments - https://hbr.org/2011/03/a-step-by-step-guide-to-smart-business-experiments/ar/1
• Evidence Based Management - https://hbr.org/2006/01/evidence-based-management/ar/5
more reference material
#adchi / #ExperimentationMindset / @DocOnDev
• Buffer Transparency - http://www.fastcompany.com/3024306/bottom-line/why-this-startup-made-their-salaries-radically-transparent
• Buffer Transparency Fail - http://www.fastcompany.com/3050682/lessons-learned/why-our-transparent-feedback-experiment-failed
• Valve - https://blog.inf.ed.ac.uk/sapm/2014/03/14/management-at-valve-an-analysis-of-management-practices-at-valve-software/
• Valve Handbook - https://www.valvesoftware.com/company/Valve_Handbook_LowRes.pdf
• Spotify White Paper - https://dl.dropboxusercontent.com/u/1018963/Articles/SpotifyScaling.pdf
• Kevin Goldsmith on Spotify - http://blog.kevingoldsmith.com/2014/03/14/thoughts-on-emulating-spotifys-matrix-organization-in-other-companies/
yet more reference material