apache spark with machine learning
TRANSCRIPT
![Page 2: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/2.jpg)
Machine learning ExamplesSpam OR Non Spam Clustering
Recommendations Market Basket Analysis
![Page 3: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/3.jpg)
What is Machine learning? It is a field of artificial intelligence, which is a sub-field of
computer science, in which we teach computers by example and ask computer to predict for new example automatically .
Ex: 1) Spam email or not spam email.
2)Product Recommendation.
3)What will be tomorrow’s temperature.
![Page 4: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/4.jpg)
Types Of Machine Learning
![Page 5: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/5.jpg)
Terminology• Observations :Items or entities used for learning or evaluation
in the context of spam detection, emails.
• Features :Are attributes used to represent an observation.
Ex:In housing prices prediction ,size,area,floors etc..
• Labels :Are values or categories assigned to observations. and again, in the context of spam detection, these can be an email being defined as spam or not spam.
• Training and test data :Observations that we use to train and evaluate a learning algorithm.
![Page 6: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/6.jpg)
![Page 7: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/7.jpg)
Tools Or Programing languages Matlab.
Octave.
R.
SAS.
SPSS.
Python.
etc..
![Page 8: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/8.jpg)
What is the Problem ? Most of the traditional analytical tools runs on single
machine.
![Page 9: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/9.jpg)
Example Spam Or Non Spam.
![Page 10: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/10.jpg)
TFIDF
i work on spark hadoop
I work on spark 1 1 1 1 0
I work on hadoop 1 1 1 0 1
![Page 11: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/11.jpg)
Cross Industry Standard Process for Data Mining(CRISP-DM)
![Page 12: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/12.jpg)
ML Use Cases Marketing
Ex:Customer segmentation, Product mix, Recommendation Sales
Ex:Demand forecasting Risk
Ex:Fraud detection Customer support
Ex:Call centers
![Page 13: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/13.jpg)
ML Use Cases Cont.. Healthcare
Ex:Survival analysis
Consumer Financial
Ex:Credit card fraud
Retail
Ex:Market Basket Analysis
Insurance
Manufacturing
![Page 14: Apache spark with Machine learning](https://reader034.vdocuments.us/reader034/viewer/2022052300/587138bd1a28abf0568b6425/html5/thumbnails/14.jpg)
Thanks