dealing with pain points of recommenders in the real world filetaylor swift pulp the smiths joy...
TRANSCRIPT
Dealing with pain points of recommenders in the real world
Sophie Watson @sophwats [email protected]
Dealing with pain points of recommenders in the real world
Sophie Watson @sophwats [email protected]
Alternating Least Squares
1 5 3
1
5
3
3
· · ·
?
· · ·
1
1
3 3
3
· · ·
· · ·
· · ·
· · ·
· · ·· · ·
· · ·· · ·
· · ·· · ·· · ·
4
4
45 5
5? ?
?2
?
?
?
? ?
1
?
≈ · · ·
≈ · · ·
?
1
≈ · · ·
1
A
B
C
1 play
10 plays
100 plays
1
1 play
10 plays
100 plays
A
B
C
Plays
Confidence
1
A
B
C
1 play
10 plays
100 plays
· · ·
1 5 3
Pain Points of ALS
???
?
???
?
time
Solutions
· · ·
· · ·
≈ · · ·
Recommendations returned to users
· ·
≈ · Data
· ·
≈ · DataRecommendations returned to users
Post-processing
· ·
≈ · DataRecommendations returned to users
Post-processing
· ·
≈ · DataRecommendations returned to users
Post-processing
NEW!
· ·
≈ · DataRecommendations returned to users
Post-processing
NEW!
time
Composable signatures for Recommendation
1 2 3
Taylor Swift Pulp
The Smiths Joy Division Billy Bragg
Taylor Swift Pulp
The Smiths Joy Division New Order
Taylor Swift Miley Cyrus
Little Mix Billie Eillish Spice Girls
1 2 3
Taylor Swift Pulp
The Smiths Joy Division Billy Bragg
Taylor Swift Pulp
The Smiths Joy Division New Order
Taylor Swift Miley Cyrus
Little Mix Billie Eillish Spice Girls
Jaccard 1 2,( (= Artist listened to Artist listened to
Artist listened to Artist listened to
1
1
2
2
∩∩
1
Taylor Swift Pulp
The Smiths Joy Division Billy Bragg
Jaccard 1 2,( (= Artist listened to Artist listened to
Artist listened to Artist listened to
1
1
2
2
=4
6
2 3
Taylor Swift Pulp
The Smiths Joy Division New Order
Taylor Swift Miley Cyrus
Little Mix Billie Eillish Spice Girls
∩∩
1
Taylor Swift Pulp
The Smiths Joy Division Billy Bragg
Jaccard 1 2,( (
=Artist listened to Artist listened to
Artist listened to Artist listened to
1
1
3
3
=1
9
2 3
Taylor Swift Pulp
The Smiths Joy Division New Order
Taylor Swift Miley Cyrus
Little Mix Billie Eillish Spice Girls
=4
6
Jaccard 1 3,( ( ∩∩
Jaccard 1 5,( (=
Jaccard 1 3,( (= 0.5
Jaccard 1 4,( (= 0.1
0.1
Jaccard 1 6,( (= 0.6
Jaccard 1 ,( (= 0.32
Jaccard 1 5,( (=
Jaccard 1 3,( (= 0.5
Jaccard 1 4,( (= 0.1
0.1
Jaccard 1 6,( (= 0.6
Jaccard 1 ,( (= 0.32
Artist id Date-timeTaylor Swift
Pulp The Smiths Joy Division Billy Bragg
1
2
1
2
Jaccard 1 2,( (=∩∩
1
2
Jaccard 1 2,( (=∩∩
1
2
Jaccard 1 2,( (= =3
10
∩∩
1
1
1
1
1
+
=
Artist id Date-time
Summer
Winter
1
2
1
2
Jaccard 1 2,( (=∩∩
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
MinHash for recommendation
1
1
Min-hash signature
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists.
∞∞∞∞∞
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists.
∞∞∞∞∞
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists.
∞∞∞∞∞
1
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists.
∞∞∞∞∞
1
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists. 11111
∞∞∞∞∞
1
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists. 11111
612,048
9856471
∞∞∞∞
1
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists. 11111
612,048
9856471
1
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists. 11111
612,048
9856471
1
4
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists. 4 612,048
9856471
4
4
44
1711,09743,861
93111,123
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists. 4 6
98
71
4
4
44
11,097
93
4
1
Min-hash signature
6
91
43
1,987
93
1
Min-hash signature
6
91
43
1,987
93
2
9,872
486
43
1,987
32,821
1
Min-hash signature
6
91
43
1,987
93
2
9,872
486
43
1,987
32,821
1
2
1
2
1
Min-hash signature
6
91
43
1,987
93
1
9,872
486
43
12
84
1
Min-hash signature
6
91
43
1,987
93
1
+ =
6
91
43
12
84
9,872
486
43
12
84
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from ARTIST NAMES to # artists.
Artist Date
Locality sensitive MinHash
1 2 3 4
1 2 3 4
}Band 1
}Band 2
}Band 3
}Band 4
}Band 5
1 2 3 4
}Band 1
}Band 2
}Band 3
}Band 4
}Band 5
h ( (Map from vecs of band size to large numbers.
1 2 3 4
}Band 1
}Band 2
}Band 3
}Band 4
}Band 5
h ( (Map from vecs of band size to large numbers.
Things we didn’t have time for
1
A
B
C
1 play
10 plays
100 plays
1 5 3
Things we have talked about
[email protected] @sophwats
[email protected] @sophwats
[email protected] @sophwats
[email protected] @sophwats