agile data science

@dhianadeva

AGILE DATA SCIENCE

Agile Tour 2015 - Niterói

AGENDA

Goal:

Encourage you to be agile using data science on your project.

● About me● Machine Learning● Similarities● Misconceptions● Non-agile Stories● Agile meets Data Science● Brighter Days

ABOUT MEElectronics Engineering, Software Development and Data Science… Why not?

DHIANA DEVA

NEURALTB

CERN

NEURALRINGER

DJBRAZIL

DAILY SMALL DATA

HIGGS CHALLENGE

HIGGS CHALLENGE

MACHINE LEARNINGIt's all about learning!

CLASSIFICATION

?

A

B

REGRESSION

? 8 15 7 1

11 13 6 3

CLUSTERING

DIMENSIONALITY REDUCTION

SIMILARITIESWe're born to be <3

LEARNING

NEURAL NETWORKS

SELF-ORGANIZING MAPS

OCCAM'S RAZOR

Among competing hypotheses, the one with the fewest assumptions

should be selected.

NON-AGILE STORIESWish I knew Martin Fowler back then!

MEMORY LEAK AT CERN

CODE AT CERN

DJBRAZIL?

MISCONCEPTIONSAgile is not for data science...

BIG UPFRONT INVESTMENTS

IT TAKES TOO LONG

ONLY FOR PHDs

SILOS

VANITY METRICS

HIPPO

AGILE MEETSDATA SCIENCEAgile and data science: a match made in heaven!

COLLABORATION

CONTINUOUS DEVELOPMENT

STRONG ENGINEERING PRACTICES

EARLY INSIGHTS

https://www.thoughtworks.com/big-data-analytics

ACTIONABLE INSIGHTS

https://www.thoughtworks.com/big-data-analytics

VALUE DRIVEN

https://www.thoughtworks.com/live/2014/europe/different-approaches-to-agile-analytics-and-customer-engagement

DATA LAKE

http://martinfowler.com/bliki/DataLake.html

AGILE ANALYTICS

BRIGHTER DAYSWe're living it!

MASSIVE ONLINEOPEN COURSES

OPEN SOURCE TOOLS

PAY-AS-YOU-GO SERVICES

A/B TESTING TOOLS

ANALYTICS TOOLS

VISUALIZATION TOOLS

WANT MORE?

THANK YOUQuestions?

Dhiana Deva

ddeva@thoughtworks.com