how can engineering take data sciences from ideas to action by adam stallard
TRANSCRIPT
![Page 1: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/1.jpg)
How Can Engineering Take Data Sciences from Ideas to Action
By Adam Stallard
![Page 2: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/2.jpg)
How Can Engineering Take Data Sciences from Ideas to Action
What is Data ScienceThe Data Scientists
Scientists vs. EngineersA Real Life Example – The Idea
RolesInto Action
Demo
![Page 3: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/3.jpg)
What is “Data Science”?
business analytics programming data engineering visualization data warehousing insight
big data mathematics probability models machine learning statistics data analytics
![Page 4: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/4.jpg)
The Data Scientists
![Page 5: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/5.jpg)
Skill Overlap
business analytics programming data engineering visualization data warehousing insight
big data mathematics probability models machine learning statistics data analytics
![Page 6: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/6.jpg)
Scientists vs. Engineers
![Page 7: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/7.jpg)
Scientists
theoretical physics explore the natural world
with theory and practical experiments
discover and expand knowledge
provide information and knowledge for the engineers
use tools/application built by engineers
![Page 8: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/8.jpg)
Engineers
robotic engineering Apply (scientific)
knowledge to solve problems
development and/or improvement of product or processes
optimise, efficiency are key (cost, tools etc)
guide others on processes and procedure
![Page 9: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/9.jpg)
Scientists vs. Engineers
“In engineering you do not start a project unless you know the answer while in science
you do not start a project if you know the answer.”
![Page 10: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/10.jpg)
The Idea: A Real Life Example
![Page 11: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/11.jpg)
Idea (aka Business Question)
Does the early opinion of Morpheus match our segmentation of potential buyers?
![Page 12: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/12.jpg)
Role of the Data Scientists
gather requirements from stakeholders prepare any existing usable data models natural language processing in R/Python/etc liaise with various team members – Data
Science Engineers analysis of data / presentation of outcome attend meetings
![Page 13: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/13.jpg)
Role of the Data Science Engineers
gather requirements from Data Scientists prepare any existing applications/processes or
develop new ones decide and research on best solution for the
task retrieve, profile, clean and integrate data automation of repetitive tasks – make life
easier liaise with various stakeholder attend meetings
![Page 14: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/14.jpg)
Data Scientist Requirements
Brief / Requirements: download user posts/comments from social
networks and dedicated gaming websites to analyse
data in csv format or integrated to data warehouse set parameters, including but not limited to website
and filter comments mobile – can be used anywhere with the correct
authentication etc.
![Page 15: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/15.jpg)
Data Science Engineers Into Action
What the DSE will be developing:
- create a website/comment scraper – modular and scalable
- comments logged to a database
- interface allows users to set parameters
- application hosted on web server
![Page 16: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/16.jpg)
Data Science Engineers Sprint Into Action
![Page 17: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/17.jpg)
First Sprint
research develop script for reddit comment scrapping log reddit comments to mysql database start application via web interface comment output
![Page 18: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/18.jpg)
Data Science Engineers – Tools of the Trade
![Page 19: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/19.jpg)
What Was Built - Application Demo bmxgamer.coeus.feralhosting.com/flask/
![Page 20: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/20.jpg)
What Was Built - Application Demo bmxgamer.coeus.feralhosting.com/flask/
![Page 21: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/21.jpg)
Just for Fun
![Page 22: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/22.jpg)
Sprint Review
Your thoughts? What would you improve? Tasks for the next sprint?
![Page 23: How Can Engineering Take Data Sciences from Ideas to Action By Adam Stallard](https://reader035.vdocuments.us/reader035/viewer/2022062801/56649e2d5503460f94b1c637/html5/thumbnails/23.jpg)
Thank you for Listening
Any Questions?