![Page 1: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/1.jpg)
Recommender SystemsProblem formulation
Machine Learning
![Page 2: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/2.jpg)
Andrew Ng
Example: Predicting movie ratings
User rates movies using one to five stars
Movie Alice (1) Bob (2) Carol (3) Dave (4)
Love at last
Romance forever
Cute puppies of love
Nonstop car chases
Swords vs. karate
= no. users= no. movies= 1 if user has rated movie = rating given by user to movie (defined only if
)
![Page 3: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/3.jpg)
Recommender SystemsContent-based recommendations
Machine Learning
![Page 4: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/4.jpg)
Andrew Ng
Content-based recommender systemsMovie Alice (1) Bob (2) Carol (3) Dave (4)
(romance) (action)
Love at last 5 5 0 0 0.9 0
Romance forever 5 ? ? 0 1.0 0.01
Cute puppies of love ? 4 0 ? 0.99 0
Nonstop car chases 0 0 5 4 0.1 1.0
Swords vs. karate 0 0 5 ? 0 0.9
For each user , learn a parameter . Predict user as rating movie with stars.
![Page 5: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/5.jpg)
Andrew Ng
Problem formulation if user has rated movie (0 otherwise)
rating by user on movie (if defined)
= parameter vector for user = feature vector for movie For user , movie , predicted rating:
= no. of movies rated by userTo learn :
![Page 6: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/6.jpg)
Andrew Ng
Optimization objective:To learn (parameter for user ):
To learn :
![Page 7: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/7.jpg)
Andrew Ng
Optimization algorithm:
Gradient descent update:
![Page 8: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/8.jpg)
Recommender Systems
Machine Learning
Collaborative filtering
![Page 9: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/9.jpg)
Andrew Ng
Problem motivationMovie Alice (1) Bob (2) Carol (3) Dave (4)
(romance) (action)
Love at last 5 5 0 0 0.9 0
Romance forever 5 ? ? 0 1.0 0.01
Cute puppies of love
? 4 0 ? 0.99 0
Nonstop car chases
0 0 5 4 0.1 1.0
Swords vs. karate 0 0 5 ? 0 0.9
![Page 10: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/10.jpg)
Andrew Ng
Problem motivationMovie Alice (1) Bob (2) Carol (3) Dave (4)
(romance) (action)
Love at last 5 5 0 0 ? ?
Romance forever 5 ? ? 0 ? ?
Cute puppies of love
? 4 0 ? ? ?
Nonstop car chases
0 0 5 4 ? ?
Swords vs. karate 0 0 5 ? ? ?
![Page 11: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/11.jpg)
Andrew Ng
Optimization algorithm
Given , to learn :
Given , to learn :
![Page 12: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/12.jpg)
Andrew Ng
Collaborative filtering
Given (and movie ratings), can estimate
Given , can estimate
![Page 13: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/13.jpg)
Recommender Systems
Machine Learning
Collaborative filtering algorithm
![Page 14: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/14.jpg)
Andrew Ng
Collaborative filtering optimization objective
Given , estimate :
Given , estimate :
Minimizing and simultaneously:
![Page 15: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/15.jpg)
Andrew Ng
Collaborative filtering algorithm1. Initialize to small random
values.2. Minimize using gradient
descent (or an advanced optimization algorithm). E.g. for every :
3. For a user with parameters and a movie with (learned) features , predict a star rating of .
![Page 16: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/16.jpg)
Recommender Systems
Machine Learning
Vectorization: Low rank matrix factorization
![Page 17: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/17.jpg)
Andrew Ng
Collaborative filteringMovie Alice (1) Bob (2) Carol (3) Dave (4)
Love at last 5 5 0 0
Romance forever 5 ? ? 0
Cute puppies of love
? 4 0 ?
Nonstop car chases
0 0 5 4
Swords vs. karate 0 0 5 ?
![Page 18: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/18.jpg)
Andrew Ng
Collaborative filtering
Predicted ratings:
![Page 19: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/19.jpg)
Andrew Ng
Finding related moviesFor each product , we learn a feature vector .
How to find movies related to movie ?
5 most similar movies to movie :Find the 5 movies with the smallest .
![Page 20: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/20.jpg)
Recommender Systems
Machine Learning
Implementational detail: Mean normalization
![Page 21: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/21.jpg)
Andrew Ng
Users who have not rated any moviesMovie Alice (1) Bob (2) Carol (3) Dave (4) Eve (5)
Love at last 5 5 0 0 ?
Romance forever 5 ? ? 0 ?
Cute puppies of love ? 4 0 ? ?
Nonstop car chases 0 0 5 4 ?
Swords vs. karate 0 0 5 ? ?
![Page 22: Recommender Systems Problem formulation Machine Learning](https://reader035.vdocuments.us/reader035/viewer/2022062320/56649d0e5503460f949e45f6/html5/thumbnails/22.jpg)
Andrew Ng
Mean Normalization:
For user , on movie predict:
User 5 (Eve):