what does a data scientist actually do? › ~dell › teaching › cc › guest ›...

13
What does a Data Scientist Actually Do? Chris Hillman

Upload: others

Post on 24-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

What does a Data Scientist Actually Do?

Chris Hillman

Page 2: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

Hyper-Hype Sexiest job of the 21st Century? Rock Stars? Ninjas? Unicorns? Data science incorporates varying elements and builds on techniques and theories from many fields, including mathematics, statistics, data engineering, pattern recognition and learning, advanced computing, visualization, uncertainty modeling, data warehousing, and high performance computing with the goal of extracting meaning from data and creating data products. Data science is a novel term that is often used interchangeably with competitive intelligence or business analytics, although it is becoming more common. Data science seeks to use all available and relevant data to effectively tell a story that can be easily understood by non-practitioners. (wikipedia, Nov 2013)

Page 3: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

Data Scientist

A better programmer than a statistician A better statistician than a programmer “Discovery consists of seeing what everybody has seen and thinking what nobody has thought." Albert Szent-Gyorgy See what all see, think what none think quod vide omnia vide, quod cogitare nullus cogitare

Page 4: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

Combination of Skills

Page 5: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

Face Detection in Images

Step

Step 1. Get a good Open Source Library

Step 2. Check the Example Code

@chillax7

Page 6: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

Character Recognition

Step

More Complex Task than Face Detection

Page 7: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

Speech to Text

Step

Fed up with word count examples?

Page 8: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

Is Big Data the new oil?

Step

Comparing Seismic surveys taken at different points in time??

Page 9: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

Proteomics

Step

Mass Spectrometers Create a lot of data…. In XML format…. It’s nasty to work with

Page 10: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

Text Mining

Step

First phases are map tasks Text Extraction and Parsing

Page 11: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

Web Analytics

Step

Find the paths that customers take through the web site and analyse the content

Page 12: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

IPTV Network

Data from a network delivering IPTV to around 300,000 customers. Need to look for quality of service issues

Page 13: What does a Data Scientist Actually Do? › ~dell › teaching › cc › guest › CC_20131213... · 2013-12-18 · A better programmer than a statistician A better statistician

Thank you

Chris Hillman [email protected] @chillax7 www.bigdatablog.co.uk