![Page 1: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/1.jpg)
Personalized Interactive Faceted Search
Jonathan Koren*, Yi Zhang*, and Xue Liu†
*University of California, Santa Cruz†McGill University
![Page 2: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/2.jpg)
Outline
• Introduce Faceted Search
• Identify Problems with Current FS Tech
• Propose a Solution
• Novel Evaluation Methodology
• Experiments
• Conclusions
2
![Page 3: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/3.jpg)
Faceted Search is Everywhere
![Page 4: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/4.jpg)
Formal Definition
• Interactive Structured Search Using Key-Value Metadata
• Parallel Hierarchies of Documents
• Point and Click Structured Query Generation
4
![Page 5: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/5.jpg)
Problems
• Too Many Facets and Values
• Existing approach: Ad Hoc Value Presentation
• Proposed Solution: Personalization and Collaborative faceted search for interactive system utility optimization
![Page 6: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/6.jpg)
Statistical Modeling Framework
• Document Model
• User Relevance Model
6
![Page 7: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/7.jpg)
Document Model
• Docs are Unique Facet-Value Pairs
• Facets Come in Different Types
• Facet-Type Suggests Statistical Model
• Docs Modeled as a Combination of Statistical Models
7
![Page 8: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/8.jpg)
User Relevance Model
!u = {P(rel | u),P(xk | rel, u),P(xk | non, u)}
8
![Page 9: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/9.jpg)
User Collaboration
• Φ is the Conjugate Prior to θu
• Φ Fills in Gaps in Individual User Models
9
Φ
θu θUθ1 θ2 θu-1
![Page 10: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/10.jpg)
Interface Evaluation
• User Studies are Expensive
• New Complementary Approach
• Expected User Interface Utility
• Simulated Interaction with Pseudousers
10
![Page 11: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/11.jpg)
User Interface Utility
• Identify Types of Actions
• Assign Costs to Actions
• Reward for Relevant Docs Retrieved
• Calculate Utility for Entire Search Session
11
![Page 12: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/12.jpg)
Expected User Interface Utility
12
E[U] =!
u!U
!
D!DE[U(u, D)]P(D | u)P(u)
E[U(u, D)] =!
t=0
!
a!At
R(qt+1, a, qt)P(qt+1 | a, qt, u)
P(a | qt, u,D)P(qt | qt"1, u,D)
![Page 13: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/13.jpg)
Assumptions
1. Users Need to Satisfy a Need with a Set of Documents
2. Users Can Recognize Relevant Documents and Facet-Value Pairs
3. Users Continue to Perform Actions Until Their Need is Met
13
![Page 14: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/14.jpg)
Pseudousers
• Stochastic Users
• First-Match Users
• Myopic Users
• Optimal Users
14
![Page 15: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/15.jpg)
B Relevant (17 matches)C Relevant (11 matches)D Nonrelevant (12 matches)E Nonrelevant (12 matches)F Relevant (15 matches)G Relevant (13 matches)H Nonelevant (4 matches)I Relevant (13 matches)J Nonrelevant (16 matches)
A Nonrelevant (14 matches)
Stochastic Users
• Picks Relevant FVP at Random
15
![Page 16: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/16.jpg)
B Relevant (17 matches)C Relevant (11 matches)D Nonrelevant (12 matches)E Nonrelevant (12 matches)F Relevant (15 matches)G Relevant (13 matches)H Nonelevant (4 matches)I Relevant (13 matches)J Nonrelevant (16 matches)
A Nonrelevant (14 matches)
First-Match Users
• Scans list for Relevant FVPs from Top to Bottom, Picking the First
16
![Page 17: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/17.jpg)
B Relevant (17 matches)C Relevant (11 matches)D Nonrelevant (12 matches)E Nonrelevant (12 matches)F Relevant (15 matches)G Relevant (13 matches)H Nonelevant (4 matches)I Relevant (13 matches)J Nonrelevant (16 matches)
A Nonrelevant (14 matches)
Myopic Users
• Picks Relevant FVP that is Contained in the Least Number of Documents
17
![Page 18: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/18.jpg)
B Relevant (17 matches)C Relevant (11 matches)D Nonrelevant (12 matches)E Nonrelevant (12 matches)F Relevant (15 matches)G Relevant (13 matches)H Nonelevant (4 matches)I Relevant (13 matches)J Nonrelevant (16 matches)
A Nonrelevant (14 matches)
Optimal Users
• Examines the Complete Interface
• Executes the Action that Maximizes the Utility
18
![Page 19: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/19.jpg)
Evaluation Review
• Each Pseudouser Logs into the Search Interface
• Pseudouser Interacts with Interface to Retrieve a Set of Documents.
• Interface Receives a Score for the Session.
• Expected Utility = Average Score for all Sessions
19
![Page 20: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/20.jpg)
Personalization Experiments
• Facet-Value Pair Suggestion
• Most Frequent
• Most Probable (Collaborative)
• Most Probable (Personalized)
• Mutual Information
• Start Page Personalization
• Empty Page
• Collaborative Page
• Personalized page
20
![Page 21: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/21.jpg)
Document Corpora
• 8000 Documents from IMDB
• 19 Facets and 367k Facet-Value Pairs
• 5000 Users Each from Netflix and MovieLens
• 633k Ratings for Netflix
• 742k Ratings for Movielens
21
![Page 22: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/22.jpg)
Results(Netflix)
0
15
30
45
60
Frequency Collab Prob Personal Prob PMI
Ave
Num
Act
ions
FVP Suggestion Method
First-Match (Null Start) Myopic (Null Start)First-Match (Collab Start) Myopic (Collab Start)First-Match (Personal Start) Myopic (Personal Start)
22
![Page 23: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/23.jpg)
Results(MovieLens)
0
20
40
60
Frequency Collab Prob Personal Prob PMI
Ave
Num
Act
ions
FVP Suggestion Method
First-Match (Null Start) Myopic (Null Start)First-Match (Collab Start) Myopic (Collab Start)First-Match (Personal Start) Myopic (Personal Start)
23
![Page 24: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/24.jpg)
Conclusions
• Many Facets and Values are a Problem
• Personalized Interfaces Can Help
• Proposed Statistical Modeling Framework for Faceted-Search
• Proposed Inexpensive Repeatable Evaluation Technique for Faceted-Search Interfaces
• Personalized Start Pages are Helpful24
![Page 25: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/25.jpg)
fin
25
![Page 26: Personalized Interactive Faceted Search · Personalized Interactive Faceted Search Jonathan Koren*, Yi Zhang*, and Xue Liu† *University of California, Santa Cruz †McGill University](https://reader035.vdocuments.us/reader035/viewer/2022081517/60190c7d5ba54f1b8b54db6e/html5/thumbnails/26.jpg)
Example: Two Myopic Users Search for “The ‘Burbs”
User: 1329
certificate=PGsoundmix=Dolbygenre=Comedycountry=USAlanguage=Englishcolorinfo=Coloryear=1989productiondesigner=SpencerJamesH
User: 302
certificate=PGsoundmix=Dolbygenre=Comedy
productiondesigner=SpencerJamesH