inferring networks of substitute and complementary products
TRANSCRIPT
![Page 1: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/1.jpg)
Jure Leskovec (@jure) Pinterest and Stanford
1 Jure Leskove, Pinterest & Stanford University
![Page 2: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/2.jpg)
2
Recommendations drive whole businesses!
Jure Leskove, Pinterest & Stanford University
![Page 3: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/3.jpg)
People and Items
3
+
–
+
+
+
–
People Items
Fundamental problem: Making items discoverable!
Jure Leskove, Pinterest & Stanford University
![Page 4: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/4.jpg)
Understanding Products
To make relevant recommendations we need to understand the products
and how they fit together
Discovering relationships between products
4 Jure Leskove, Pinterest & Stanford University
![Page 5: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/5.jpg)
Product Graph
Ingest product catalogs: 10s of millions of products 100s of millions of descriptions, reviews
Infer product networks with multiple types of directed relationships: Input:
Data about items (products)
Output:
Network with multiple types of relationships
5 Jure Leskove, Pinterest & Stanford University
![Page 6: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/6.jpg)
Product Graph: Relations
6
Substitutes:
Purchase
instead
Complements:
Purchase
in addition
Jure Leskove, Pinterest & Stanford University
![Page 7: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/7.jpg)
Product Graph: Description
7
: cleaner; quieter
: cheaper; high power
: well made, easy to install
: fits perfectly, great value Jure Leskove, Pinterest & Stanford University
![Page 8: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/8.jpg)
Product Graph: Overview
8
substitute complement
Jure Leskove, Pinterest & Stanford University
![Page 9: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/9.jpg)
Product Graph: What it does?
1. Understands the notions of substitute and complement goods
is substitutable for
complements
9 Jure Leskove, Pinterest & Stanford University
![Page 10: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/10.jpg)
Product Graph: What it does?
2. Generates explanations of why certain products are
preferred
“Good quality, soft, light weight, the colors are
beautiful and exactly like the picture!”
People prefer this because:
10 Jure Leskove, Pinterest & Stanford University
![Page 11: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/11.jpg)
Product Graph: What it does?
3. Discovers micro-categories of products
Small clusters of tightly related products:
11 Jure Leskove, Pinterest & Stanford University
![Page 12: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/12.jpg)
Product Graph: What it does?
4. Recommends baskets of related products
Query: Suggested outfit:
Query: Suggested outfit:
12 Jure Leskove, Pinterest & Stanford University
![Page 13: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/13.jpg)
Product Graph: Overview
Building networks from products
Modeling: Can we use product data to model product relationships?
Understanding: Can we explain why people prefer certain products
over others?
13 Jure Leskove, Pinterest & Stanford University
![Page 14: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/14.jpg)
Problem Setting
Binary prediction task: Given a pair of products, x and y, predict
whether they are related (substitute/complementary)
Goal: Build a probabilistic model
that encodes
14 Jure Leskove, Pinterest & Stanford University
![Page 15: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/15.jpg)
Problem Setting
How to learn
from data
Train by maximum likelihood:
15
X Complementary
Not Complementary
Jure Leskove, Pinterest & Stanford University
![Page 16: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/16.jpg)
Approach
Products are described by their properties:
Review text, Product description, Brand, Price, …
[0.3, 0, 0, 0.3, 0, 0, 0.2, 0, 0, 0.1] [0.1, 0, 0, 0, 0.2, 0, 0, 0.1, 0, 0.2]
Challenges:
How do we discover right features?
How do we explain relationships?
How do we identify micro-categories?
16
Shoes Female
Jure Leskove, Pinterest & Stanford University
![Page 17: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/17.jpg)
Our Solution: SCEPTRE
Link Prediction
Review “topics”
Discover topics that “explain” product relations 17
Learn to discover topics that explain the product graph
Jure Leskove, Pinterest & Stanford University
![Page 18: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/18.jpg)
Challenges: Relation Direction
why do people who view X eventually buy Y?
Relationships we want to learn are not symmetric
18
Relationships: Explained by product “properties” “baby, pajamas, pants, colorful”
Directedness: Subjective/qualitative language “true size, fits well, items are the same color as on the picture”
Jure Leskove, Pinterest & Stanford University
![Page 19: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/19.jpg)
Challenges: Multiple Relations
19
We want to learn multiple relationships simultaneously
Solution: Learn multiple regressors (one for each graph), that operate on a single set of topics
Jure Leskove, Pinterest & Stanford University
![Page 20: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/20.jpg)
Challenges: Micro-Categories
20
Model discovers thousands of topics but no micro-categories
Solution: Product hierarchy
Laptop charger specific topics are only active for chargers.
These are micro-categories.
Topics at the top are common to all electronics products, and will contain
generic electronics language
Associate each node in the category tree with a small number of topics:
Jure Leskove, Pinterest & Stanford University
![Page 21: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/21.jpg)
Building the Graph
C++ implementation that runs on a single (large-memory) machine
OpenMP to parallelize computations
Experimental results: Active part of the Amazon catalog
10m products
150m reviews
250m relationships
21 Jure Leskove, Pinterest & Stanford University
![Page 22: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/22.jpg)
Example: Product Graph
22 Jure Leskove, Pinterest & Stanford University
![Page 23: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/23.jpg)
Example: Product Graph
23 Jure Leskove, Pinterest & Stanford University
![Page 24: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/24.jpg)
Edge Prediction Accuracy
24
Substitute Complement
Men’s Clothing
96.7% 94.1%
Women’s Clothing
95.9% 94.1%
Books 93.8% 89.9%
Electronics 95.7% 88.8%
Movies 85.6% -
Music 90.4% -
OVERALL 94.83% 90.23%
Jure Leskove, Pinterest & Stanford University
![Page 25: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/25.jpg)
Results: Micro-Categories
25 Jure Leskove, Pinterest & Stanford University
![Page 26: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/26.jpg)
27
How does all this fit into Pinterest?
Jure Leskove, Pinterest & Stanford University
![Page 27: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/27.jpg)
Connecting People & Objects
28 Jure Leskove, Pinterest & Stanford University
![Page 28: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/28.jpg)
Pins: Richly Annotated Objects
29 Jure Leskove, Pinterest & Stanford University
![Page 29: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/29.jpg)
Pins are Collected in Boards
30 Jure Leskove, Pinterest & Stanford University
![Page 30: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/30.jpg)
30+ Billion Pins categorized by people into more than
750 Million Boards
50% of pins have been created
in the last 6 months 31
![Page 31: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/31.jpg)
32
Discovering relationships between objects
Jure Leskove, Pinterest & Stanford University
![Page 33: Inferring networks of substitute and complementary products](https://reader033.vdocuments.us/reader033/viewer/2022042819/55cad444bb61ebbf438b456f/html5/thumbnails/33.jpg)
References
Inferring Networks of Substitutable and Complementary Products by J. McAuley, R. Pandey, J. Leskovec. ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), 2015.
Hidden Factors and Hidden Topics: Understanding Rating Dimensions with Review Text by J. McAuley, J. Leskovec. ACM Conference on Recommender Systems (RecSys), 2013.
Learning Attitudes and Attributes from Multi-Aspect Reviews by J. McAuley, J. Leskovec, D. Jurafsky. IEEE International Conference On Data Mining (ICDM), 2012.
34 Jure Leskove, Pinterest & Stanford University