introducing machine learning

22
MACHINE LEARNING Machine can do what we do.

Upload: hui-hong-teh

Post on 22-Mar-2017

48 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Introducing Machine Learning

MACHINE LEARNING

Machine can do what we do.

Page 2: Introducing Machine Learning

What is Machine Learning?A method of data analysis that automates analytical model building.

Using algorithms that iteratively learn from data.

In short, Machine Learning is make the machine learn something itself.

Page 4: Introducing Machine Learning

Applications of Machine Learning Face Detection used in Facebook and Coursera.

Language Understanding used in Slackbot.

Recommendations used in Netflix and Spotify.

Google and Baidu self driving car.

Page 5: Introducing Machine Learning

How it works?Typically classified into three boards categories:a. Supervised Learning

b. Unsupervised Learning

Page 6: Introducing Machine Learning

Supervised Learning “Right answer” given as final result - an input where the desired output is known.

Regression Problem - Predict continuous valued output

Page 7: Introducing Machine Learning

Supervised Learning “Right answer” given as final result - an input where the desired output is known.

Classification Problem

Page 8: Introducing Machine Learning

Supervised Learning Algorithms of supervised learning :

Logistic Regression

Linear Regression

Neural Network

ANOVA Quadratic Classifier

Decision Tree

Support Vector

Machine

Page 9: Introducing Machine Learning

Unsupervised Learning Used against data that has no historical labels. The algorithm must figure out what is being shown.

Clustering Problem

Page 10: Introducing Machine Learning

The teamAnswer the question, “Why are we the ones to solve the problem we identified?”

Market Segmentation

Social Network Analysis

News Summarisation

Recommender Systems

Unsupervised Learning Applications of unsupervised learning :

Page 11: Introducing Machine Learning

Unsupervised Learning Algorithms of unsupervised learning :

Hierarchical Clustering

K-mean Clustering

Gaussian Mixture Models

Hidden Markov Model

Quadratic Classifier

Decision Tree

Self-organizing Mapping

Page 12: Introducing Machine Learning

Recommender SystemsExample: Netflix Movie Recommendation

Alice (1) Brandon (2) Carmen (3) Dave (4)

Star War 1 1 5 4

Captain America

1 1 5 ?

Kung Fu Panda

? 4 1 ?

Zootopia 5 5 1 1

Lilo & Stitch 5 ? ? 1

nm = no. of

moviesnu = no. of users

r ( i , j ) = 1, if user j has rated movie iy ( i , j ) = rating given by user j to movie i

Page 13: Introducing Machine Learning

Recommender SystemsExample: Netflix Movie Recommendation

Alice (1) Brandon (2)

Carmen (3) Dave (4) Action (x1) Cartoon (x2)

Star War 1 1 5 4 1 0

Captain America

1 1 5 ? 1 0

Kung Fu Panda

? 4 1 ? 0 1

Zootopia 5 5 1 1 0 1

Lilo & Stitch 4 ? ? 1 0 1

Movie Features

Page 14: Introducing Machine Learning

Recommender SystemsProblem Formulation

r (i,j) = 1 if user j has rated movie iy (i,j) = rating given by user j to movie i

𝛳(j) = parameter vector for user jx(i) = feature vector for movie iFor user j and movie i, predicted rating = (𝛳(j))T(x(i))

To learn 𝛳(j):

Page 15: Introducing Machine Learning

Recommender SystemsProblem Formulation

To learn 𝛳(j) parameter for user j:

To learn 𝛳(1), 𝛳(1), … , 𝛳(nu):

Page 16: Introducing Machine Learning

Recommender SystemsCollaborative Filtering

Alice (1) Brandon (2)

Carmen (3) Dave (4) Action (x1) Cartoon (x2)

Star War 1 1 5 4 ? ?

Captain America

1 1 5 ? ? ?

Kung Fu Panda

? 4 1 ? ? ?

Zootopia 5 5 1 1 ? ?

Lilo & Stitch 4 ? ? 1 ? ?(𝛳(1))Tx(1) = 1 (𝛳(2))Tx(1)

= 1(𝛳(3))Tx(1) = 5 (𝛳(4))Tx(1)

= 4

Page 17: Introducing Machine Learning

Recommender SystemsProblem Formulation

Given 𝛳(1), 𝛳(2), … , 𝛳(nu), to learn x(i):

Given 𝛳(1), 𝛳(2), … , 𝛳(nu), to learn x(1), x(2), … x(nm), :

Page 18: Introducing Machine Learning

Recommender SystemsCollaborative Filtering

Given x(1), … x(nm) and movies rating, can estimate 𝛳(1), … , 𝛳(nu)Given 𝛳(1), … , 𝛳(nu), can estimate x(1), … x(nm)

Guess 𝛳 x 𝛳 x 𝛳 ...

Page 19: Introducing Machine Learning

How it works

Step 1Initialize x or with 𝛳small random values.

Step 2Minimize J(x, ) for every 𝛳 i = 1, …, nm and j = 1, …, nu

Step 3Predict movie rating with 𝛳Tx

Page 20: Introducing Machine Learning

How to get similar movies?Action (x1) Cartoon (x2)

Star War (x(1)) 1 0

Captain America (x(2))

1 0

Kung Fu Panda (x(3))

0 1

Zootopia (x(4)) 0 1

Lilo & Stitch (x(5)) 0 1Minimum value of | x(5) - x(i) |, i

from 1 - 4

Page 21: Introducing Machine Learning

Q & A

Page 22: Introducing Machine Learning