eigenrank: a ranking oriented approach to collaborative filtering by nathan n. liu and qiang yang...
TRANSCRIPT
![Page 1: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/1.jpg)
1
EigenRank: A ranking oriented approach to collaborative filtering
By Nathan N. Liu and Qiang YangPresented by Zachary
![Page 2: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/2.jpg)
2
Outline
• Recommender system• Motivation• Memory-based CF– Similarity measure– User based– Item based
• EigenRank– Model– Prediction– Experiments and results
![Page 3: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/3.jpg)
3
Recommender System
• Recommender systems try to recommend items to user based on – Your existing rating for
some items
![Page 4: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/4.jpg)
4
Motivation
• Ultimate goal of recommender system is to produce a list of items that a specific user would prefer.
• Rating V.S. RankingItem True rating Predicted
ratingPredicted rating
1 4 4.5 2.8
2 5 4.3 4.1
3 2 2.1 2.6
MAE: 0.4 MAE: 0.9
![Page 5: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/5.jpg)
5
Problem definition
• Given – m users– n items– Users’ rating on items R (partial data)
• Produce– A list of items that active user might like
m x n matrix, represents user u’s rating on item i. if u has not rated i.
![Page 6: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/6.jpg)
6
Memory based CF
• We have no information regarding the content of an item
• Ratings are the only data we have• For an active user (user based)– Find users similar to active user• For rated items, they tend to give similar ratings
– Based on their ratings for an item– Predict the rating that active user would assign
![Page 7: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/7.jpg)
7
Memory based CF
Average rating that u gives
Set of similar users(Neighborhood)
Set of users that rated i
Similarity between u and v
![Page 8: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/8.jpg)
8
Similarity Measure
• For the memory based model to work, we need a similarity measure– Pearson Correlation Coefficient– Vector similarity– Adjusted cosine similarity
![Page 9: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/9.jpg)
9
Pearson Correlation Coefficient
![Page 10: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/10.jpg)
10
Vector similarity
• Also known as cosine similarity• Measures the cosine value of two vectors in
high dimensionDot product
Product of length
![Page 11: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/11.jpg)
11
Adjusted cosine similarity
• Used to measure item similarity
![Page 12: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/12.jpg)
12
User based V.S. Item based
User based• For active user u
– Consider all similar user V– Combine their rating for i to
predict– PCC or VS is often used
Item based• For active item i
– Consider all similar item– Combine user u’s rating for all
of them to predict– Adjusted cosine similarity is
often used
![Page 13: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/13.jpg)
13
EigenRank
• Ranking oriented model– No rating prediction– Output a ranking instead
![Page 14: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/14.jpg)
14
EigenRank
• Define preference function
Indicate item i is prefered to j
Magnitude denote the strength of preference
Additional requirements
![Page 15: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/15.jpg)
15
EigenRank
• The following definition is a valid preference function
The set of neighboring users who have rated both i and j
![Page 16: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/16.jpg)
16
Kendall Rank Correlation Coefficient
• A similarity measure between two rankings of the same set of objects
Indicator function
![Page 17: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/17.jpg)
17
Kendall Rank Correlation Coefficient
• KRCC is good at capturing the preference relationship between items rather than the actual rating
Item User1's rating User2's rating1 2 32 3 43 4 5
![Page 18: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/18.jpg)
18
EigenRank
• For a ranking , we define a value function V as:
• Then, to predict a ranking, we want to find maximizing V
![Page 19: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/19.jpg)
19
EigenRank
• It is proved that solving the following problem is NP-Complete
• Resort to approximate solutions– Greedy algorithm– Random walk algorithm
![Page 20: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/20.jpg)
20
Greedy algorithm• Time complexity
•
Can be seen as utility of i
Eliminate the effect of i
![Page 21: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/21.jpg)
21
Random walk algorithm
• Model the problem as a first-order Markov Chain– States items– Transition probability preference function
– Stationary distribution a ranking
![Page 22: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/22.jpg)
22
Random walk algorithm
• Transition probability from item i to j is:
Probability distribution after t steps Probability of being at item 2 after t steps
Principle eigen vector of P
![Page 23: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/23.jpg)
23
Experiments and Results
• Data set– EachMovie(6.1% non-zero entries)– Netflix (6.6% non-zero entries)– Random pick 10600 users who have rated more
than 40 movies• 10000 user for training• 100 parameter tuning• 500 active user
– 50% training– 50% testing
![Page 24: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/24.jpg)
24
Experiments and evaluation
• Metric used for evaluation– NDCG
Set of users included in test data
Rate assigned by u to item at position p
Normalization term
![Page 25: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/25.jpg)
25
Experiments and evaluation
• Impact of neighborhood size
![Page 26: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/26.jpg)
26
Experiments and evaluation
![Page 27: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/27.jpg)
27
Q&A
• Any questions?
![Page 28: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/28.jpg)
28
Appendix
• Personalization Vector
![Page 29: EigenRank: A ranking oriented approach to collaborative filtering By Nathan N. Liu and Qiang Yang Presented by Zachary 1](https://reader037.vdocuments.us/reader037/viewer/2022110321/56649f535503460f94c7773c/html5/thumbnails/29.jpg)
29
Appendix
• Impact of