Upload File

devsci: improving software through data scienceskill 2016 change skill 2016 change. what’s the...

  • Home
  • Documents
  • DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
104
Data Science: Becoming a Data-driven Organization @MatthewRenze #MicrosoftUAE

Upload: others

Post on 04-Jun-2020

2 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Data Science:Becoming a Data-driven Organization

@MatthewRenze

#MicrosoftUAE

Page 2: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 3: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Are you a decision maker?

Page 4: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Are you flooded with data?

Are you a decision maker?

Page 5: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Are you flooded with data?

Are you a decision maker?

Are you using data science?

Page 6: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Why is it important?

What is data science?

How do I get started?

Page 7: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

What is data science?

Why is it important?

How do I get started?

Page 8: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Why is data science important?

Page 9: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 10: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 11: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 12: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 13: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Job Postings for Data Scientists

Page 14: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Source: Dice Salary Survey 2017

Top-paying Tech SkillsSkill 2016 Change Skill 2016 Change

Page 15: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 16: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 17: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 18: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

What’s the problem?

Page 19: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

What’s the problem?

Page 20: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 21: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 22: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 23: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 24: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 25: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 26: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 27: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 28: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

The Current State of Business

Don’t understand customersLack of product-market fit

Unused / low-value features

Missed market opportunities

Human biases

Guesswork

Cost of labor

Human errors

Page 29: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 30: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Three Main Approaches

Createbetter

products

Makesmarter

decisions

Reduce laborcosts

Page 31: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Three Main Approaches

Createbetter

products

Page 32: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Three Main Approaches

Makesmarter

decisions

Page 33: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Three Main Approaches

Reduce laborcosts

Page 34: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Three Main Approaches

Createbetter

products

Makesmarter

decisions

Reduce laborcosts

Page 35: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

What is data science?

Page 36: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Computer

science

Math and

statistics

Domain

knowledge

Data

science

Page 37: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Data

engineering

Scientific

method

Data

science

Page 38: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Data Knowledge Decision Action

Page 39: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

What Is a Data Scientist?

Performs data science

More than a scientist

More than an analyst

More than a developer

Page 40: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

What skills are necessary?

Page 41: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Data Science Skills

Programming

Working with data

Descriptive statistics

Data visualization

Page 42: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Data Science Skills

Programming

Working with data

Descriptive statistics

Data visualization

Statistical modeling

Handling Big Data

Machine learning

Deploying to production

Page 43: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

What tools are used?

Page 44: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

70%

60%

40%

30%

20%

10%

0%

50%

SQ

L

Exc

el

Pyt

ho

n

MyS

QLR

Pyt

ho

n t

oo

ls

gg

plo

t

SQ

L Serv

er

Tab

leau

Java

Scr

ipt

Matp

lotl

ib

Java

Po

stg

reSQ

L

Ora

cle

D3

Ho

meg

row

n

Hiv

e

Sp

ark

Clo

ud

era

Vis

ual B

asi

c

Mo

ng

oD

B

Had

oo

p

SA

S

C+

+

Sca

la

Po

werP

ivo

t

SQ

Lite C

Pig

Red

Sh

ift

Weka

Hb

ase

(EM

R)

Perl

SP

SS

Tera

data

Tool: language, platform, analytics

Sh

are

of

Resp

on

den

ts

Source: O’Reilly 2015 Data Science Salary Survey

Data Science Tools

Page 45: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

70%

60%

40%

30%

20%

10%

0%

50%

SQ

L

Exc

el

Pyt

ho

n

MyS

QLR

Pyt

ho

n t

oo

ls

gg

plo

t

SQ

L Serv

er

Tab

leau

Java

Scr

ipt

Matp

lotl

ib

Java

Po

stg

reSQ

L

Ora

cle

D3

Ho

meg

row

n

Hiv

e

Sp

ark

Clo

ud

era

Vis

ual B

asi

c

Mo

ng

oD

B

Had

oo

p

SA

S

C+

+

Sca

la

Po

werP

ivo

t

SQ

Lite C

Pig

Red

Sh

ift

Weka

Hb

ase

(EM

R)

Perl

SP

SS

Tera

data

Tool: language, platform, analytics

Sh

are

of

Resp

on

den

ts

Source: O’Reilly 2015 Data Science Salary Survey

Data Science Tools

Page 46: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

70%

60%

40%

30%

20%

10%

0%

50%

SQ

L

Exc

el

Pyt

ho

n

MyS

QLR

Pyt

ho

n t

oo

ls

gg

plo

t

SQ

L Serv

er

Tab

leau

Java

Scr

ipt

Matp

lotl

ib

Java

Po

stg

reSQ

L

Ora

cle

D3

Ho

meg

row

n

Hiv

e

Sp

ark

Clo

ud

era

Vis

ual B

asi

c

Mo

ng

oD

B

Had

oo

p

SA

S

C+

+

Sca

la

Po

werP

ivo

t

SQ

Lite C

Pig

Red

Sh

ift

Weka

Hb

ase

(EM

R)

Perl

SP

SS

Tera

data

Tool: language, platform, analytics

Sh

are

of

Resp

on

den

ts

Source: O’Reilly 2015 Data Science Salary Survey

Data Science Tools

Page 47: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

70%

60%

40%

30%

20%

10%

0%

50%

SQ

L

Exc

el

Pyt

ho

n

MyS

QLR

Pyt

ho

n t

oo

ls

gg

plo

t

SQ

L Serv

er

Tab

leau

Java

Scr

ipt

Matp

lotl

ib

Java

Po

stg

reSQ

L

Ora

cle

D3

Ho

meg

row

n

Hiv

e

Sp

ark

Clo

ud

era

Vis

ual B

asi

c

Mo

ng

oD

B

Had

oo

p

SA

S

C+

+

Sca

la

Po

werP

ivo

t

SQ

Lite C

Pig

Red

Sh

ift

Weka

Hb

ase

(EM

R)

Perl

SP

SS

Tera

data

Tool: language, platform, analytics

Sh

are

of

Resp

on

den

ts

Source: O’Reilly 2015 Data Science Salary Survey

Data Science Tools

Page 48: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

70%

60%

40%

30%

20%

10%

0%

50%

SQ

L

Exc

el

Pyt

ho

n

MyS

QLR

Pyt

ho

n t

oo

ls

gg

plo

t

SQ

L Serv

er

Tab

leau

Java

Scr

ipt

Matp

lotl

ib

Java

Po

stg

reSQ

L

Ora

cle

D3

Ho

meg

row

n

Hiv

e

Sp

ark

Clo

ud

era

Vis

ual B

asi

c

Mo

ng

oD

B

Had

oo

p

SA

S

C+

+

Sca

la

Po

werP

ivo

t

SQ

Lite C

Pig

Red

Sh

ift

Weka

Hb

ase

(EM

R)

Perl

SP

SS

Tera

data

Tool: language, platform, analytics

Sh

are

of

Resp

on

den

ts

Source: O’Reilly 2015 Data Science Salary Survey

Data Science Tools

Page 49: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

How is data science performed?

Page 50: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

The Data Science Process

Data

Page 51: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

The Data Science Process

Find a question

Data

Page 52: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

The Data Science Process

Find a question

Collectthe data

Data

Page 53: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

The Data Science Process

Find a question

Collectthe data

Preparethe data

Data

Page 54: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

The Data Science Process

Find a question

Collectthe data

Preparethe data

Create a model

Data

Page 55: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

The Data Science Process

Find a question

Collectthe data

Preparethe data

Create a model

Evaluatethe model

Data

Page 56: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

The Data Science Process

Find a question

Collectthe data

Preparethe data

Create a model

Evaluatethe model

Deploythe model

Data

Page 57: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

The Data Science Process

Find a question

Collectthe data

Preparethe data

Createa model

Evaluatethe model

Deploythe model

Data

Page 58: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

The Data Science Process

Iterative process

Find a question

Explore the data

Prepare the data

Create a model

Evaluate the

model

Deploy the

model

Data

Page 59: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

The Data Science Process

Iterative process

Non-sequential

Find a question

Explore the data

Prepare the data

Create a model

Evaluate the

model

Deploy the

model

Data

Page 60: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

The Data Science Process

Iterative process

Non-sequential

Early termination

Find a question

Explore the data

Prepare the data

Create a model

Evaluate the

model

Deploy the

model

Data

Page 61: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

How do I get started?

Page 62: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

What are the ingredients ofa data-driven enterprise?

Page 63: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Strategy

People

DataTechnology

Culture

Page 64: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Strategy

Page 65: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 66: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

People

Page 67: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 68: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Data

Page 69: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 70: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Technology

Page 71: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 72: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Culture

Page 73: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 74: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

What is the process of becominga data-driven enterprise?

Page 75: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

AI

Predict

Analyze

Organize

Collect

Page 76: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

AI

Predict

Analyze

Organize

Collect

Need

s

Page 77: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

1. Collect

Collect

Page 78: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

1. Collect

Transactions

Logging

Digitization

Collect

Page 79: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

1. Collect

Transactions

Logging

Digitization

Telemetry

Experiments

External dataCollect

Page 80: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

2. Organize

Organize

Collect

Page 81: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

2. Organize

Transform

Clean

Store

Organize

Collect

Page 82: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

2. Organize

Transform

Clean

Store

Data ETL

Data Warehouse

Data Lake

Organize

Collect

Page 83: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

3. Analyze

Analyze

Organize

Collect

Page 84: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

3. Analyze

Reports

Dashboards

KPI monitors

Analyze

Organize

Collect

Page 85: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

3. Analyze

Reports

Dashboards

KPI monitors

Data mining

Descriptive analytics

Diagnostic analytics

Analyze

Organize

Collect

Page 86: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

4. Predict

Predict

Analyze

Organize

Collect

Page 87: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

4. Predict

Predictive analytics

Prescriptive analytics

Machine learning

Predict

Analyze

Organize

Collect

Page 88: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

5. Automate AI

Predict

Analyze

Organize

Collect

Page 89: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

5. Automate

Artificial intelligence

Reinforcement learning

Deep learning

AI

Predict

Analyze

Organize

Collect

Page 90: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

AI

Predict

Analyze

Organize

Collect

Page 91: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

AI

Predict

Analyze

Organize

Collect

Page 92: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Advice for Success

Get buy-in from leadership

Focus on low-hanging fruit

Don’t silo data science teamsDemocratize your data

Page 93: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Advice for Success

Get buy-in from leadership

Focus on low-hanging fruit

Don’t silo data science teamsDemocratize your data

Embrace smart failure

Focus on feedback

Embed data collection

Avoid the Observer Effect

Page 94: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Where to Go Next?

Page 95: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Where to Go Next

Data Camp: https://www.datacamp.com

Pluralsight: https://www.pluralsight.com

Coursera: https://www.coursera.org

https://www.datacamp.com/
https://www.pluralsight.com/
https://www.coursera.org/
Page 96: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

www.pluralsight.com/authors/matthew-renze

Pluralsight Courses

Data Science: The Big Picture

Data Science with R

Exploratory Data Analysis with R

Data Visualization with R (3-part)

Deep Learning: The Big Picture

https://www.pluralsight.com/authors/matthew-renze

Page 97: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

www.matthewrenze.com

Page 98: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Feedback

Very important to me!

What did you like?

What could I improve?

Page 99: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Conclusion

Page 100: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Why is it important?

What is data science?

How do I get started?

Page 101: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 102: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Is your organization?

Are you prepared?

Is our world prepared?

Page 103: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data
Page 104: DevSci: Improving Software Through Data ScienceSkill 2016 Change Skill 2016 Change. What’s the problem? What’s the problem? ... O’Reilly 2015 Data Science Salary Survey Data

Thank You!

Matthew Renze

Data Science Consultant

Renze Consulting

Twitter: @matthewrenze

Email: [email protected]

Website: www.matthewrenze.com

https://twitter.com/MatthewRenze
mailto:[email protected]
http://www.matthewrenze.com/

Math Unit Plan: What’s in a Word Problem? file · Web viewLucina Ayvazian 2013Math Unit Plan: What’s in a Word Problem? Lucina Ayvazian . 2013. Math Unit Plan: What’s in a Word

Bridging the Gap Between Privacy and Data Insight Insight.pdf · What’s the Problem with Securing Big Data? • Hadoop Beyond Kerberos • New Protection Techniques ... Discovery

Chapter One – What’s the problem?€¦ · Chapter One – What’s the problem? Philosophical theories Philosophers over the millennia have struggled with versions of this prob-lem

Terminology in Statistical Information Integration Tasks: What’s the Problem?

What’s the problem with JavaScript?

CSE6011 Data Warehouse and OLAP Why data warehouse What’s data warehouse What’s multi-dimensional data model What’s difference between OLAP and

Day Two: What’s the Problem? What’s the Plan?€¦ · Day Two: What’s the Problem? What’s the Plan? Explore (20 minutes) Children will practice identifying problems and create

What is person-centred care?. HOSPITAL What’s the problem?

What’s the problem of Mo’s?

What’s in Your Problem Solving Toolbox?

What’s the problem? TYPES OF CONFLICT IN LITERATURE

NEXT What’s Your Problem, Mate? (English Error ID)

what’s PROBLEM? SO, WHAT’S THE PROBLEM?georgearmstrongelementary.enschool.org/ourpages/auto/2020/3/20/58643978...Mar 20, 2020  · o Prudy's Problem and How She Solved It by Carey

What’s The Problem…. …What’s The Solution Moving from Time Management to being a Time Strategist

€¦ · OECD Skills Studies 2015 OECD Skills Studies Adults, Computers and Problem Solving: What’s the Problem? OECD Skills Studies Adults, Computers and Problem Solving: What’s

What’s My Area? Geometry and Problem Solving€¦ · ... What’s My Area? Geometry and Problem Solving ... o Two dimensional ... perimeter of the rectangle

“Servicing Made Simple” Assean Sheikh. So what’s the problem?

What’s the problem?

“What’s your Problem?” Research Project [12th grade]

Adults, Computers and Problem Solving: What’s the Problem?

What’s new in – PROBLEM-BASED LEARNING CLINICAL …archive.u21health.org/sites/u21health.org/files/V6.pdf1 What’s new in – PROBLEM-BASED LEARNING CLINICAL SKILLS CURRICULUM

HWW Gene Expression Experiments: How? Why? What’s the problem?

What’s The Problem? Presented by Enactus of Berkeley

So what’s the problem

What’s your problem?

Seniors and Problem Gambling what’s the problem?? “ the problem is not gambling…. the problem is problem gambling”

What’s New in Data?

Common Toxicological Errors: What’s the problem here?

The landscape and the multiverse: What’s the problem?

What’s The Problem…. …What’s The Solution

What’s Data Communications

Quantum limits on estimating a waveform What’s the problem?

What’s the Problem

Housing affordability in the DMV: What’s the problem & how

What’s your problem? Legal Technology Legal Management