leveraging unusual data sources

38
Leveraging Unusual Data Sources Brian Lange, Data Scientist at

Upload: brian-lange

Post on 12-Apr-2017

280 views

Category:

Data & Analytics


3 download

TRANSCRIPT

Page 1: Leveraging Unusual Data Sources

Leveraging Unusual Data Sources

Brian Lange, Data Scientist at

Page 2: Leveraging Unusual Data Sources
Page 3: Leveraging Unusual Data Sources

(our) 6 qualities of a great data scientist

1. Statistical thinking 2. Technical acumen 3. Multi-modal communication skills 4. Curiosity 5. Creativity 6. Grit

Page 4: Leveraging Unusual Data Sources

(our) 6 qualities of a great data scientist

1. Statistical thinking 2. Technical acumen 3. Multi-modal communication skills 4. Curiosity 5. Creativity 6. Grit

Page 5: Leveraging Unusual Data Sources

Why think outside the box?

Page 6: Leveraging Unusual Data Sources

What’s exciting about“Big Data”?

Page 7: Leveraging Unusual Data Sources

thanks for the graph, Mike Stringer

Page 8: Leveraging Unusual Data Sources

taking a quantified approach where one was not previously possible is where the greatest gains get made

Page 9: Leveraging Unusual Data Sources

an example

Page 10: Leveraging Unusual Data Sources

This is Kathie.

Page 11: Leveraging Unusual Data Sources

P&G has thousands of researchers & engineers across the globe

Page 12: Leveraging Unusual Data Sources

Kathie's job is to help them work together.

Page 13: Leveraging Unusual Data Sources

WE BUILT KATHIE A PEOPLE SEARCH ENGINE

Solution 1: “expert finder”

Page 14: Leveraging Unusual Data Sources

Japan

UK

USA

JapanUK

USA

Solution 2: strategic dataviz

Page 15: Leveraging Unusual Data Sources

Japan

UK

USA

JapanUK

USA

vs. expected collaboration rate

0%

15%

-15%

Page 16: Leveraging Unusual Data Sources

Lorem Ipsum: a narrative about blankets. Author: Charlie Brown Date: 31 Jan 2012

Lorem Ipsum is a dummy text used when typesetting or marking up documents. It has a long history starting from the 1500s and is still used in digital millennium for typesetting electronic documents, page designs, etc.

In itself, the original text of Lorem Ipsum might have been taken from an ancient Latin book that was written about 50 BC. Nevertheless, Lorem Ipsum’s words have been changed so they don’t read as a proper text.

Naturally, page designs that are made for text documents must contain some text rather than placeholder dots or something else. However, should they contain proper English words and sentences almost every reader will deliberately try to interpret it eventually, missing the design itself.

However, a placeholder text must have a natural distribution of letters and punctuation or otherwise the markup will look strange and unnatural. That’s what Lorem Ipsum helps to achieve.

I would like to thank Peppermint Patty for her support on studying Lorem Ipsum as well as the infinite wisdom of Linus van Pelt and his willingness to use his blanket in my experiments.

Both of these are powered by data derived from employee reports.

Page 17: Leveraging Unusual Data Sources

determine authorship + publish date

Lorem Ipsum: a narrative about blankets.

Author: Charlie Brown Date: 31 Jan 2012 Lorem Ipsum is a dummy text used when typesetting or marking up documents. It has a long history starting from the 1500s and is still used in digital millennium for typesetting electronic documents, page designs, etc.

In itself, the original text of Lorem Ipsum might have been taken from an ancient Latin book that was written about 50 BC. Nevertheless, Lorem Ipsum’s words have been changed so they don’t read as a proper text.

Naturally, page designs that are made for text documents must contain some text rather than placeholder dots or something else. However, should they contain proper English words and sentences almost every reader will deliberately try to interpret it eventually, missing the design itself.

However, a placeholder text must have a natural distribution of letters and punctuation or otherwise the markup will look strange and unnatural. That’s what Lorem Ipsum helps to achieve.

I would like to thank Peppermint Patty for her support on studying Lorem Ipsum as well as the infinite wisdom of Linus van Pelt and his willingness to use his blanket in my experiments.

Page 18: Leveraging Unusual Data Sources

determine authorship + publish date

Lorem Ipsum: a narrative about blankets.

Author: Charlie Brown Date: 31 Jan 2012 Lorem Ipsum is a dummy text used when typesetting or marking up documents. It has a long history starting from the 1500s and is still used in digital millennium for typesetting electronic documents, page designs, etc.

In itself, the original text of Lorem Ipsum might have been taken from an ancient Latin book that was written about 50 BC. Nevertheless, Lorem Ipsum’s words have been changed so they don’t read as a proper text.

Naturally, page designs that are made for text documents must contain some text rather than placeholder dots or something else. However, should they contain proper English words and sentences almost every reader will deliberately try to interpret it eventually, missing the design itself.

However, a placeholder text must have a natural distribution of letters and punctuation or otherwise the markup will look strange and unnatural. That’s what Lorem Ipsum helps to achieve.

I would like to thank Peppermint Patty for her support on studying Lorem Ipsum as well as the infinite wisdom of

Linus van Pelt and his willingness to use his blanket in my experiments.

find citations + mentions of other employees

Page 19: Leveraging Unusual Data Sources

determine authorship + publish date

find citations + mentions of other employees

Lorem Ipsum: a narrative about blankets.

Author: Charlie Brown Date: 31 Jan 2012 Lorem Ipsum is a dummy text used when typesetting or marking up documents. It has a long history starting from the 1500s and is still used in digital millennium for typesetting electronic documents, page designs, etc.

In itself, the original text of Lorem Ipsum might have been taken from an ancient Latin book that was written about 50 BC. Nevertheless, Lorem Ipsum’s words have been changed so they don’t read as a proper text.

Naturally, page designs that are made for text documents must contain some text rather than placeholder dots or something else. However, should they contain proper English words and sentences almost every reader will deliberately try to interpret it eventually, missing the design itself.

However, a placeholder text must have a natural distribution of letters and punctuation or otherwise the markup will look strange and unnatural. That’s what Lorem Ipsum helps to achieve.

I would like to thank Peppermint Patty for her support on studying Lorem Ipsum as well as the infinite wisdom of

Linus van Pelt and his willingness to use his blanket in my experiments.

determine subject matter using Wikipedia

plastics, sustainability, 3d printing

Page 20: Leveraging Unusual Data Sources

How do you come up with this stuff?

Page 21: Leveraging Unusual Data Sources

1. define a business problem to solve

Page 22: Leveraging Unusual Data Sources

If you had 1,000 interns, what

would you have them do?

Page 23: Leveraging Unusual Data Sources

1. define a business problem to solve2. explore potential solutions

Page 24: Leveraging Unusual Data Sources

start lo-fi

Page 25: Leveraging Unusual Data Sources

refine as the needs clarify

Page 26: Leveraging Unusual Data Sources
Page 27: Leveraging Unusual Data Sources

1. define a business problem to solve2. explore potential solutions3. go hunting for data to support the solution you’ve narrowed on

Page 28: Leveraging Unusual Data Sources

1. define a business problem to solve2. explore potential solutions3. go hunting for data to support the solution you’ve narrowed on

Page 29: Leveraging Unusual Data Sources

1. define a business problem to solve2. explore potential solutions3. go hunting for data to support the solution you’ve narrowed on

Page 30: Leveraging Unusual Data Sources

inspirational kernels of

wisdom time

Page 31: Leveraging Unusual Data Sources

the place you work has problems that data has never touched

Page 32: Leveraging Unusual Data Sources

reportsoffice sensors public APIs

civic/census dataoffice network usage

social media project management tools

sensors in your products server logsCRMs

enthusiast forumsjob applications

email activity surveyscalendar data

Page 33: Leveraging Unusual Data Sources

superheroes

Page 34: Leveraging Unusual Data Sources

superheroes

Page 35: Leveraging Unusual Data Sources

managers: set up your team to be capable of taking advantage of unusual data sources

Page 36: Leveraging Unusual Data Sources

choose tools that are adaptable, and have "good I/O"

Page 37: Leveraging Unusual Data Sources

choose people that are creative.

get them up close and personal with the real business problems

Page 38: Leveraging Unusual Data Sources

thanks!@bjlange

datascope.co/team/brian-lange