![Page 1: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/1.jpg)
E
@benlee
foursquare explore +assorted data fun
![Page 2: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/2.jpg)
Overview
foursquare data stats explore similar places interesting phrases venue transitions
2
![Page 3: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/3.jpg)
15,000,000+ people
30,000,000+ places
1,500,000,000+ check-ins
Data
![Page 4: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/4.jpg)
4
![Page 5: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/5.jpg)
E
foursquare explore
![Page 6: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/6.jpg)
![Page 7: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/7.jpg)
![Page 8: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/8.jpg)
![Page 9: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/9.jpg)
Explore Flow
• Query parsing
• Retrieval
• Ranking
• Reason generation
![Page 10: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/10.jpg)
Overview: RetrievalVenue Index
Candidate Venues
Social Interactions
Check-in History
Venue attributes
PersonalInteractions
![Page 11: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/11.jpg)
Social Interactions
Venue attributes
PersonalInteractions
Global scores Social Scores PersonalScores
Top K venues
Global reasons
Social reasons
Personalreasons
Overview: Ranking / Reasons
![Page 12: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/12.jpg)
Global attributes
• Time decayed popularity
• Time of day / day of week filtering
• Total interactions (# tips, todos etc)
![Page 13: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/13.jpg)
Blue bottle
![Page 14: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/14.jpg)
Social / Personal scores
• # Friends that have checkins
• Tips left by friends, etc
• Prior visits by user
• Similar places user has been in the past
![Page 15: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/15.jpg)
Venue Similarity
Incredibly SparseMatrixU
sers
Venuesvi vj
for all i,jsim(vi, vj)
![Page 16: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/16.jpg)
Venue Similarity w/ MapReduce
visited venues map
reduce
vi, vj
vi, vj
vi, vj
user
emit “all” pairs of visited venues for each user
Sum up each user’s score contribution to this pair of venues
score
score
key
key
score scorescore ...
...
final score
![Page 17: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/17.jpg)
17
![Page 18: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/18.jpg)
18
![Page 19: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/19.jpg)
Reason generation
- “Dennis left a tip here”- “You and 4 friends have been here”- “This place is on your To-do list”
19
![Page 20: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/20.jpg)
Improving explore
New signals– Tourist / Local– Everyday / Once-and-awhile– Expert rank
Retrieval improvment–Synonyms / query rewriting–Query category matching–Menu text
20
![Page 21: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/21.jpg)
E
assorted data fun
![Page 22: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/22.jpg)
Interesting phrases
• Hack day project on tip text
• Build a n-gram model, find “improbable” phrases relative to background corpus
• Inspired by Amazon’s statistically improbable phrases (SIPs) feature
![Page 23: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/23.jpg)
barn cellar, famous pig, grey spider, old sheep, egg sac
69 Modern Classics Condensed via Amazon’s SIPs
![Page 24: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/24.jpg)
stillsuit manufacturer, panoplia propheticus, gom jabbar, inkvine scar, ducal signet, factory crawler, poison snooper
69 Modern Classics Condensed via Amazon’s SIPs
![Page 25: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/25.jpg)
drip coffees, best coffee, jack dorsey, no wifi, using square
Interesting Venue Phrases
![Page 26: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/26.jpg)
Interesting Venue Phrases
bootie sf, hubba hubba revue, death guild
![Page 27: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/27.jpg)
Interesting Venue Phrases
salted caramel, balsamic strawberry, roasted banana, honey lavender,
![Page 28: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/28.jpg)
City level phrases
deep dish pizza, celery salt, hot dog
clam chowder, lobster roll, red sox
bread pudding, cafe au lait, bloody mary
breakfast tacos, mexican martinis, fried avocado
fried chicken, blue bottle, french toast
![Page 29: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/29.jpg)
Phrases by time
![Page 30: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/30.jpg)
Venue transitions
Users check in ~3 times a dayWhat can we learn from where they go next?
30
![Page 31: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/31.jpg)
31
![Page 32: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/32.jpg)
32
![Page 33: Foursquare data quick talk @ BBQ Check in 3/21/12](https://reader034.vdocuments.us/reader034/viewer/2022042813/54925793ac795925288b4796/html5/thumbnails/33.jpg)
Thanks
foursquare.com/jobs
@benlee