insights, predictions, and actions - test science · 2018-03-20 · insights, predictions, and...

32
Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence Andrew Flack

Upload: others

Post on 18-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Insights, Predict ions, and Act ions

Descript ive Definit ions of Data Science, Machine Learning, and Art ificial Intelligence

Andrew Flack

dkluzik
Cleared
dkluzik
Slides Only
Page 2: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

The terms “Data Science,” “Machine Learning,” and “Art ificial Intelligence” are increasingly common.

1

Page 3: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

DoD must stay on the cut t ing edge in technology, culture, operat ions, and processes.

2

Defense Innovation Advisory Board

Recommendat ion 5: Catalyze Innovat ions in Art if icial Intel l igence and Machine Learning

Page 4: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

“Textbook” definit ions are not terribly helpful.

4http:/ / fortune.com/ ai-artificial- intelligence-deep-machine-learning/

Page 5: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Textbook definit ions are not terribly helpful.

5https:/ / steemit.com/ education/ @agmakosz/ the-approaching-impact-of-a-i-on-the-education-industry

Page 6: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Is it just market ing?

6https:/ / twitter.com/ xaprb/ status/ 930674776317849600

Page 7: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Forget the formal definit ions and hierarchies.

7

What does a practitioner in each discipline actually do?

Page 8: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Data Science Produces InsightsMachine Learning Makes Predict ions

Art ificial Intelligence Produces Act ions

8

Page 9: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Data science is the process of obtaining, t ransforming, analyzing, and communicat ing data to answer a quest ion.

Data Question

Raw Data

Tidy Data

Data Analysis

• Descriptive, exploratory, predictive, inferential, causal, or mechanistic

Data Product

• Business question / analytical question

• Collecting, scraping

• Cleansing, preparation

• Report, visualization, model, tool, other decision aid

Page 10: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Who is a data scient ist?

10

Page 11: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Head of IT Analyst

The Num be rCrunche r

The Sale spe rson

Com pute r Scie nce

Profe ssor

Sta tis tics Profe ssor

Hot Air GoodConsultant

The Data Ne rd

The Hacke r

R Core Te am

The IT Guy

The Accountant

The Data

Scie ntis t

Com m unication

Statis tics Program m ing

Busine ss

Who is a data scient ist?

Page 12: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Isn’t this just an Operat ions Research / Systems Analyst (ORSA)? Not quite …

12

No Data Some Data “Big Data”

Op e ra tions Re se a rch

Da ta Sc ie nce

Page 13: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

“Data Science” in Defense

13

Is this friendly activity (cordon and search, raid, road block, etc.) reducing enemy activity?

Compare the number of enemy events, before and after a friendly activity, to see if there is a significant difference.

Page 14: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Data Science in Defense

14

Page 15: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Data Science in the wild

15

Who are the most profitable customers?

Is there really a difference between profitable customers and the average customer?

Can I characterize customers in some way?

Page 16: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Data Science Produces InsightsMachine Learning Makes Predict ions

Art ificial Intelligence Produces Act ions

16

Page 17: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Discover a function 𝒚𝒚=𝒇𝒇(𝒙𝒙) that be st p re d ic ts the value of 𝒚𝒚associate d with e ach value of 𝒙𝒙.

17

Page 18: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

If the response variable is numeric, we’re doing regression.*

18

* In this context, we’re using regression to PREDICT, not to EXPLAIN.

See Shmueli, G. 2010. “To Explain or to Predict?,” Statistical Science (25:3), pp. 289-310.

Page 19: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

If the response is categorical, it is a classificat ion task.

19

Petal

Sepal

Iris Setosa Iris Versicolor

Page 20: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Find a funct ion that maps each at t ribute set to one of the predefined class labels.

20

Page 21: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Find “Learn” a funct ion that maps each at t ribute set to one of the predefined class labels …

21

Page 22: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

… and generalizes to make accurate predict ions on previously unseen data.

22

Page 23: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Separat ion between these disciplines is blurry.

24

DataScience

MachineLearning

ArtificialIntelligence

LogisticRegression

Page 24: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Machine Learning in Defense

25

Page 25: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Machine Learning in Defense

26

“… augment or automate Processing, Exploitation, and Dissemination (PED) for tactical Unmanned Aerial System

(UAS) and Mid-Altitude Full-Motion Video (FMV) …”

“38 classes of objects the department needs to detect”

Page 26: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Machine Learning in the wild

27

Page 27: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Data Science Produces InsightsMachine Learning Makes Predict ions

Art ificial Intelligence Produces Act ions

28

Page 28: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Rather than teaching computers how to do everything, teach them to learn for themselves.

29

Arthur Samuel, a pioneer in Artificial Intelligence, created a program to play checkers.

He was the first to develop a machine that surpassed his ability in a task that he taught it.

Page 29: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Again, separat ion between these disciplines is blurry.

30

DeepLearning

DataScience

MachineLearning

ArtificialIntelligence

Page 30: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Art ificial Intelligence in the wild

31

Page 31: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence

Data Science Produces InsightsMachine Learning Makes Predict ions

Art ificial Intelligence Produces Act ions

32

Page 32: Insights, Predictions, and Actions - Test Science · 2018-03-20 · Insights, Predictions, and Actions Descriptive Definitions of Data Science, Machine Learning, and Artificial Intelligence