data analytics using deep learningjarulraj/courses/8803-f18/slides/09_vocalization.pdfrestaurant...
TRANSCRIPT
![Page 1: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/1.jpg)
DATA ANALYTICS USING DEEP LEARNINGGT 8803 // FALL 2018 // JACOB
LOGAS
L E C T U R E # 0 9 : D ATA V O C A L I Z AT I O N : O P T I M I Z I N G V O I C E O U T P U T O F R E L AT I O N A L D ATA
![Page 2: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/2.jpg)
GT 8803 // Fall 2018
TODAY’S PAPER
• Data Vocalization: Optimizing Voice Output
of Relational Data– New dimension to data delivery
– Formalize voice output optimization problem
• Authors: Immanuel Trummer, Jiancheng
Zhu, Mark Bryan
• Slides based on Trummer presentation @
VLDB 2017
2
![Page 3: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/3.jpg)
GT 8803 // Fall 2018
TODAY’S PAPER
3
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
Restaurants with Traditional American cuisine and four to five stars user average rating:Upstate.John’s.The View.
Restaurants with three to four stars user average rating:Thai Castle with Thai cuisine.Paris with French cuisine.La Masseria with Italian cuisine.
![Page 4: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/4.jpg)
GT 8803 // Fall 2018
TODAY’S AGENDA
• Context: Data Visualization
• Problem Overview
• Key Idea
• Technical Details
• Experiments
• Discussion
4
![Page 5: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/5.jpg)
GT 8803 // Fall 2018
What is Data Visual izat ion?
• 1987– NSF started “Scientific Visualization”
• Transforms data into images– Represent information about data
• Tool to enable User insight into Data– Intuitive understanding of data
5
![Page 6: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/6.jpg)
GT 8803 // Fall 2018
What Does Visual izat ion Do?
• Goals
6This Photo by Unknown Author is licensed under CC BY-SAThis Photo by Unknown Author is licensed under CC BY-SA-NCThis Photo by Unknown Author is licensed under CC BY
![Page 7: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/7.jpg)
GT 8803 // Fall 2018
What Does Visual izat ion Do?
• Goals– Explore
• Used for data exploration
6This Photo by Unknown Author is licensed under CC BY-SAThis Photo by Unknown Author is licensed under CC BY-SA-NCThis Photo by Unknown Author is licensed under CC BY
![Page 8: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/8.jpg)
GT 8803 // Fall 2018
What Does Visual izat ion Do?
• Goals– Explore
• Used for data exploration
– Analyze
• Used for verification
6This Photo by Unknown Author is licensed under CC BY-SAThis Photo by Unknown Author is licensed under CC BY-SA-NCThis Photo by Unknown Author is licensed under CC BY
![Page 9: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/9.jpg)
GT 8803 // Fall 2018
What Does Visual izat ion Do?
• Goals– Explore
• Used for data exploration
– Analyze
• Used for verification
– Present
• Used for Communication of Results
6This Photo by Unknown Author is licensed under CC BY-SAThis Photo by Unknown Author is licensed under CC BY-SA-NCThis Photo by Unknown Author is licensed under CC BY
![Page 11: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/11.jpg)
GT 8803 // Fall 2018 8
Visual izat ion Cons
• Overwhelming
• Slowing
• Noisy
• Re-reading
• Skimming
This Photo by Unknown Author is licensed under CC BY-SA
![Page 12: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/12.jpg)
GT 8803 // Fall 2018
Audio Presentat ion
• Quick
• Concise
• Memorable
• Low Cognitive
Load
9
![Page 13: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/13.jpg)
GT 8803 // Fall 2018
Limits of Short Term Memory
• Impose limits on information– Receive
– Process
– Remember
• Recoding to beat bottleneck
• Information theory
10
Miller, G. A. (1956). The magical number seven, plus or minus two: some limits on our capacity for processing information. Psychological Review, 63(2), 81-97. http://dx.doi.org/10.1037/h0043158
![Page 14: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/14.jpg)
GT 8803 // Fall 2018
Overview
• Given input relation
• Find time-optimal vocalization
• Constrained by– Precision
– Output structure
– Memory load
11
![Page 16: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/16.jpg)
GT 8803 // Fall 2018
Naive
13
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
Upstate with Traditional American cuisine and four point seven five stars user average rating. Thai Castle with Thai cuisine and three point three starsuser average rating. John’s with Traditional American cuisine and four point seven starsuser average rating. Paris with French cuisine and three point three starsuser average rating. The View with Traditional American cuisine and four point nine stars user average rating. La Masseria with Italian cuisine and three point two starsaverage rating.
This Photo by Unknown Author is licensed under CC BY-ND
![Page 17: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/17.jpg)
GT 8803 // Fall 2018
Naive
13
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
Upstate with Traditional American cuisine and four point seven five stars user average rating. Thai Castle with Thai cuisine and three point three starsuser average rating. John’s with Traditional American cuisine and four point seven starsuser average rating. Paris with French cuisine and three point three starsuser average rating. The View with Traditional American cuisine and four point nine stars user average rating. La Masseria with Italian cuisine and three point two starsaverage rating.
502 Characters
This Photo by Unknown Author is licensed under CC BY-ND
![Page 18: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/18.jpg)
GT 8803 // Fall 2018
Naive
13
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
Upstate with Traditional American cuisine and four point seven five stars user average rating. Thai Castle with Thai cuisine and three point three starsuser average rating. John’s with Traditional American cuisine and four point seven starsuser average rating. Paris with French cuisine and three point three starsuser average rating. The View with Traditional American cuisine and four point nine stars user average rating. La Masseria with Italian cuisine and three point two starsaverage rating.
502 Characters
This Photo by Unknown Author is licensed under CC BY-ND
![Page 19: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/19.jpg)
GT 8803 // Fall 2018
Naive
13
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
Upstate with Traditional American cuisine and four point seven five stars user average rating. Thai Castle with Thai cuisine and three point three starsuser average rating. John’s with Traditional American cuisine and four point seven starsuser average rating. Paris with French cuisine and three point three starsuser average rating. The View with Traditional American cuisine and four point nine stars user average rating. La Masseria with Italian cuisine and three point two starsaverage rating.
502 Characters
This Photo by Unknown Author is licensed under CC BY-ND
![Page 20: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/20.jpg)
GT 8803 // Fall 2018
Naive
13
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
Upstate with Traditional American cuisine and four point seven five stars user average rating. Thai Castle with Thai cuisine and three point three starsuser average rating. John’s with Traditional American cuisine and four point seven starsuser average rating. Paris with French cuisine and three point three starsuser average rating. The View with Traditional American cuisine and four point nine stars user average rating. La Masseria with Italian cuisine and three point two starsaverage rating.
502 Characters
This Photo by Unknown Author is licensed under CC BY-ND
![Page 21: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/21.jpg)
GT 8803 // Fall 2018
More Concise
14
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
La Masseria with Italian cuisine and three point two stars average rating.
Restaurants with Traditional American cuisine:Upstate with four point seven five stars user average rating. John’s with four point seven stars user average rating. The View with four point nine stars user average rating.
Restaurants with three point three stars user average rating:Thai Castle with Thai cuisine. Paris with French cuisine.
![Page 22: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/22.jpg)
GT 8803 // Fall 2018
Contexts
More Concise
14
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
La Masseria with Italian cuisine and three point two stars average rating.
Restaurants with Traditional American cuisine:Upstate with four point seven five stars user average rating. John’s with four point seven stars user average rating. The View with four point nine stars user average rating.
Restaurants with three point three stars user average rating:Thai Castle with Thai cuisine. Paris with French cuisine.
![Page 23: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/23.jpg)
GT 8803 // Fall 2018
More Concise
14
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
La Masseria with Italian cuisine and three point two stars average rating.
Restaurants with Traditional American cuisine:Upstate with four point seven five stars user average rating. John’s with four point seven stars user average rating. The View with four point nine stars user average rating.
Restaurants with three point three stars user average rating:Thai Castle with Thai cuisine. Paris with French cuisine.
Scopes
![Page 24: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/24.jpg)
GT 8803 // Fall 2018
More Concise
14
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
La Masseria with Italian cuisine and three point two stars average rating.
Restaurants with Traditional American cuisine:Upstate with four point seven five stars user average rating. John’s with four point seven stars user average rating. The View with four point nine stars user average rating.
Restaurants with three point three stars user average rating:Thai Castle with Thai cuisine. Paris with French cuisine.
502 → 416 Characters
![Page 25: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/25.jpg)
GT 8803 // Fall 2018
More Concise
14
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
La Masseria with Italian cuisine and three point two stars average rating.
Restaurants with Traditional American cuisine:Upstate with four point seven five stars user average rating. John’s with four point seven stars user average rating. The View with four point nine stars user average rating.
Restaurants with three point three stars user average rating:Thai Castle with Thai cuisine. Paris with French cuisine.
502 → 416 Characters
![Page 26: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/26.jpg)
GT 8803 // Fall 2018
More Concise
14
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
La Masseria with Italian cuisine and three point two stars average rating.
Restaurants with Traditional American cuisine:Upstate with four point seven five stars user average rating. John’s with four point seven stars user average rating. The View with four point nine stars user average rating.
Restaurants with three point three stars user average rating:Thai Castle with Thai cuisine. Paris with French cuisine.
502 → 416 Characters
![Page 27: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/27.jpg)
GT 8803 // Fall 2018
Even More Concise
15
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
Restaurants with Traditional American cuisine and four to five stars user average rating:Upstate.John’s.The View.
Restaurants with three to four stars user average rating:Thai Castle with Thai cuisine.Paris with French cuisine.La Masseria with Italian cuisine.
![Page 28: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/28.jpg)
GT 8803 // Fall 2018
Even More Concise
15
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
Restaurants with Traditional American cuisine and four to five stars user average rating:Upstate.John’s.The View.
Restaurants with three to four stars user average rating:Thai Castle with Thai cuisine.Paris with French cuisine.La Masseria with Italian cuisine.
416 → 267 Characters
![Page 29: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/29.jpg)
GT 8803 // Fall 2018
Even More Concise
15
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
John’sTraditional American
4.7
Paris French 3.3
The ViewTraditional American
4.9
La Masseria Italian 3.2
Restaurants with Traditional American cuisine and four to five stars user average rating:Upstate.John’s.The View.
Restaurants with three to four stars user average rating:Thai Castle with Thai cuisine.Paris with French cuisine.La Masseria with Italian cuisine.
416 → 267 Characters
![Page 30: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/30.jpg)
GT 8803 // Fall 2018
The Optimizat ion Problem
• Input: relation to vocalize
• Search Space: sequence of scopes
• Constraints𝐶𝑜𝑛𝑡𝑒𝑥𝑡 𝑆𝑖𝑧𝑒 ≤ 𝑆
– Categorical value domain:
𝐷𝑜𝑚𝑎𝑖𝑛 𝑆𝑖𝑧𝑒 ≤ 𝐶– Numerical value domains:
𝑈𝑝𝑝𝑒𝑟 𝐵𝑜𝑢𝑛𝑑 ≤ 𝐿𝑜𝑤𝑒𝑟 𝐵𝑜𝑢𝑛𝑑 ∗𝑊
• Objective: Minimize speaking time
16
Memory
Precision
Precision
![Page 31: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/31.jpg)
GT 8803 // Fall 2018
The Optimizat ion Problem
• Input: relation to vocalize
• Search Space: sequence of scopes
• Constraints𝐶𝑜𝑛𝑡𝑒𝑥𝑡 𝑆𝑖𝑧𝑒 ≤ 𝑆
– Categorical value domain:
𝐷𝑜𝑚𝑎𝑖𝑛 𝑆𝑖𝑧𝑒 ≤ 𝐶– Numerical value domains:
𝑈𝑝𝑝𝑒𝑟 𝐵𝑜𝑢𝑛𝑑 ≤ 𝐿𝑜𝑤𝑒𝑟 𝐵𝑜𝑢𝑛𝑑 ∗𝑊
• Objective: Minimize speaking time
16
Memory
Precision
Precision
NP Hard
![Page 32: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/32.jpg)
GT 8803 // Fall 2018
Proof
• Represent as vertex cover
• One edge per row
• One vertex per category column
• 𝛼 if vertex incident to an edge
• Other values are mutually different
• Vertex cover is NP hard
17Photo by Fschwarzentruber / CC BY
![Page 34: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/34.jpg)
GT 8803 // Fall 2018
Algorithms Overview
• Integer Programming
• Two-Phase Algorithm
• Greedy Approach
19Image used with permission of Immanuel Trummer from VLDB 2017 slide deck (http://www.itrummer.org/slides/Vocalization5.pdf)
![Page 35: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/35.jpg)
GT 8803 // Fall 2018
Algorithms Overview
• Integer Programming
• Two-Phase Algorithm
• Greedy Approach
19Image used with permission of Immanuel Trummer from VLDB 2017 slide deck (http://www.itrummer.org/slides/Vocalization5.pdf)
![Page 36: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/36.jpg)
GT 8803 // Fall 2018
Integer L inear Programming ( ILP)
20
Input relation
Precision constraints
Memory constraints
![Page 37: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/37.jpg)
GT 8803 // Fall 2018
Integer L inear Programming ( ILP)
20
Input relation
Precision constraints
Memory constraints
Transformation to ILP
![Page 38: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/38.jpg)
GT 8803 // Fall 2018
Integer L inear Programming ( ILP)
20
Input relation
Precision constraints
Memory constraints
Transformation to ILP
ILP Solver
Integer Linear Program
Variables
Linear Constraints
Linear Objective
![Page 39: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/39.jpg)
GT 8803 // Fall 2018
Integer L inear Programming ( ILP)
20
Input relation
Precision constraints
Memory constraints
Transformation to ILP
ILP Solver
Solution
Integer Linear Program
Variables
Linear Constraints
Linear Objective
![Page 40: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/40.jpg)
GT 8803 // Fall 2018
Integer L inear Programming ( ILP)
20
Input relation
Precision constraints
Memory constraints
Transformation to ILP
ILP Solver
Voice Output
Solution
Integer Linear Program
Variables
Linear Constraints
Linear Objective
![Page 41: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/41.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
![Page 42: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/42.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
Variables
![Page 43: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/43.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
• Needed: 1|0
• Needed: 1|0
Variables
![Page 44: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/44.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
• Needed: 1|0
• Rows: [1…n]
• Needed: 1|0
• Rows: [1…n]
Variables
![Page 45: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/45.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
Variables
![Page 46: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/46.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
Variables
![Page 47: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/47.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
Constraints
![Page 48: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/48.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
1
1
Constraints
![Page 49: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/49.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
1
1
Constraints
Row [1…n]
![Page 50: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/50.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
1
1
Constraints
Row [1…n]
![Page 51: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/51.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
1
1
Constraints
Row [1…n]
Bounded
Bounded
![Page 52: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/52.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
1
1
Constraints
Row [1…n]
Sufficiently Small Δ
Sufficiently Small Δ
Bounded
Bounded
![Page 53: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/53.jpg)
GT 8803 // Fall 2018
How Do We Transform?
21
Context 1: Restaurants with…
Restaurants within scope 1.
…
Context n: Restaurants with…
Restaurants within scope n.
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
• Needed: 1|0
• Rows: [1…n]
• Attributes: Category
• Values: Range(a,b)
1
1
Constraints
Row [1…n]
Sufficiently Small Δ
Sufficiently Small Δ
Bounded
Bounded
Optimal
Slow
![Page 54: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/54.jpg)
GT 8803 // Fall 2018
Two-Phase
22
Phase 1: Generate Context Candidates
Phase 2: Map Rows to Candidates
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
Extract4 to 5 stars
Traditional American cuisine
Traditional American cuisine and 4 to 5 stars
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
4 to 5 stars
Traditional American cuisine
Traditional American cuisine and 4 to 5 stars
Mapping
![Page 55: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/55.jpg)
GT 8803 // Fall 2018
Two-Phase
22
Phase 1: Generate Context Candidates
Phase 2: Map Rows to Candidates
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
Extract4 to 5 stars
Traditional American cuisine
Traditional American cuisine and 4 to 5 stars
Restaurant Cuisine Rating
UpstateTraditional American
4.75
Thai Castle Thai 3.3
4 to 5 stars
Traditional American cuisine
Traditional American cuisine and 4 to 5 stars
Mapping
FastNo
guarantee
![Page 56: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/56.jpg)
GT 8803 // Fall 2018
Phase 1: Generate
23Figure used with permission of Immanuel Trummer from Optimizing voice-based output of relational data
![Page 57: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/57.jpg)
GT 8803 // Fall 2018
Phase 1: Generate
• Voice Rule– Based on apriori rule
– A context is useful iff time to say less than
time saved
– Time saved: The potential savings from naïve
• Lemma 1: A specialization of a useless
context is useless
• Lemma 2: Row cover is submodular
24
![Page 58: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/58.jpg)
GT 8803 // Fall 2018
Phase 2: Mapping
• Again uses integer programming
• Much simpler than last one
• Add an empty context
• New optimization goal
25
![Page 59: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/59.jpg)
GT 8803 // Fall 2018
Greedy
26
Find Optimal Voice Output
Optimal
Exp
on
enti
al
![Page 60: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/60.jpg)
GT 8803 // Fall 2018
Greedy
26
Find Optimal Context Set
Find Optimal Voice Output
Optimal
Optimal
Exp
on
enti
al
Po
lyn
om
ial
![Page 61: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/61.jpg)
GT 8803 // Fall 2018
Greedily Construct Context Set
Greedy
26
Find Optimal Context Set
Find Optimal Voice Output
Optimal
Optimal
Exp
on
enti
al
Po
lyn
om
ial
?
Po
lyn
om
ial
![Page 62: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/62.jpg)
GT 8803 // Fall 2018
Greedily Construct Context Set
Greedy
26
Find Optimal Context Set
Find Optimal Voice Output
Optimal
Optimal
Exp
on
enti
al
Po
lyn
om
ial
?
Po
lyn
om
ial
T({context}) Properties that hold:1. Submodular2. Monotone3. Non-negative
![Page 63: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/63.jpg)
GT 8803 // Fall 2018
Greedily Construct Context Set
Greedy
26
Find Optimal Context Set
Find Optimal Voice Output
Optimal
Optimal
Exp
on
enti
al
Po
lyn
om
ial
Po
lyn
om
ial
T({context}) Properties that hold:1. Submodular2. Monotone3. Non-negative
Near-Optimal
![Page 64: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/64.jpg)
GT 8803 // Fall 2018
Greedily Construct Context Set
Greedy
26
Find Optimal Context Set
Find Optimal Context Set
Find Optimal Voice Output
Optimal
Po
lyn
om
ial
Po
lyn
om
ial
T({context}) Properties that hold:1. Submodular2. Monotone3. Non-negative
Near-Optimal
?
Po
lyn
om
ial
![Page 65: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/65.jpg)
GT 8803 // Fall 2018
Greedily Construct Context Set
Greedy
26
Find Optimal Context Set
Find Optimal Context Set
Find Optimal Voice Output
Optimal
Po
lyn
om
ial
Po
lyn
om
ial
T({context}) Properties that hold:1. Submodular2. Monotone3. Non-negative
Near-Optimal
?
T(assignments) Properties that hold:1. Submodular2. Non-negative
Po
lyn
om
ial
![Page 66: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/66.jpg)
GT 8803 // Fall 2018
Greedily Construct Context Set
Greedy
26
Find Optimal Context Set
Find Optimal Context Set
Find Optimal Voice Output
Optimal
Po
lyn
om
ial
Po
lyn
om
ial
T({context}) Properties that hold:1. Submodular2. Monotone3. Non-negative
Near-Optimal
T(assignments) Properties that hold:1. Submodular2. Non-negative
Po
lyn
om
ial
Near-Optimal
![Page 67: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/67.jpg)
GT 8803 // Fall 2018
Greedily Construct Context Set
Greedy
26
Find Optimal Context Set
Find Optimal Context Set
Find Optimal Voice Output
Optimal
Po
lyn
om
ial
Po
lyn
om
ial
T({context}) Properties that hold:1. Submodular2. Monotone3. Non-negative
Near-Optimal
T(assignments) Properties that hold:1. Submodular2. Non-negative
Po
lyn
om
ial
Near-Optimal
PolynomialOptimal
![Page 69: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/69.jpg)
GT 8803 // Fall 2018
Scope
• Restaurants
• Mobile Phones
• Football Statistics
• Laptop Models
28
![Page 70: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/70.jpg)
GT 8803 // Fall 2018
Configurat ions
• Naïve Baseline
• Integer Programming
• Two-Phase Algorithm
• Greedy Approach
29
![Page 71: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/71.jpg)
GT 8803 // Fall 2018
Metrics
• User Preference– Mechanical Turks
• Speech Length
• Optimization Time
30
![Page 72: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/72.jpg)
GT 8803 // Fall 2018
User Preference
31Image used with permission of Immanuel Trummer from VLDB 2017 slide deck (http://www.itrummer.org/slides/Vocalization5.pdf)
![Page 73: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/73.jpg)
GT 8803 // Fall 2018
Speech Length
32
PrecisionComplexity
HighLow
MediumLow
LowLow
HighMedium
MediumMedium
LowMedium
No
rmal
ized
Len
gth
# Rows
![Page 74: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/74.jpg)
GT 8803 // Fall 2018
Optimizat ion Time
33
PrecisionComplexity
HighLow
MediumLow
LowLow
HighMedium
MediumMedium
LowMedium
No
rmal
ized
Len
gth
# Rows
![Page 76: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/76.jpg)
GT 8803 // Fall 2018
Strengths?
• Iterative improvement on algorithm
• Relevance to new device interactions
• Takes into account cognition of users
• Good heuristics for cognitive load
35
![Page 77: DATA ANALYTICS USING DEEP LEARNINGjarulraj/courses/8803-f18/slides/09_vocalization.pdfRestaurant Cuisine Rating Upstate Traditional American 4.75 Thai Castle Thai 3.3 John’s Traditional](https://reader033.vdocuments.us/reader033/viewer/2022053004/5f0889757e708231d4227fce/html5/thumbnails/77.jpg)
GT 8803 // Fall 2018
Weaknesses or Assumptions Made?
• Audio and Video Representations are
equivalent
• Evaluation takes place locally
• Google’s heuristics are applicable here
• Interaction is one-sided
• Poor visualization of results
• Largely ignores natural language
36