james cook krishnaram abhimanyu das kenthapadi nina mishra · 2020-05-02 · 1 ranking twitter...
TRANSCRIPT
![Page 1: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/1.jpg)
1
Ranking Twitter Discussion Groups
James Cook
Krishnaram Kenthapadi Nina MishraAbhimanyu Das
COSN 2014
![Page 2: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/2.jpg)
2
Outline
● Twitter discussion groups● Our algorithm● Theoretical results● Evaluation
![Page 3: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/3.jpg)
3
Group Chats on Twitter[C, Kenthapadi, Mishra 2013]
![Page 4: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/4.jpg)
4
#MTOS
![Page 5: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/5.jpg)
5
![Page 6: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/6.jpg)
6
The Suspense Is Killing Me
1. How do you define suspense in the cinema? As a viewer, do you consider suspense a desirable trait in a film?
2A. What is the greatest “suspense film” you’ve ever seen? Why?
2B. What’s the best, most suspenseful movie scene or sequence you can think of?
http://nitratediva.wordpress.com
![Page 7: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/7.jpg)
7
![Page 8: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/8.jpg)
8
![Page 9: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/9.jpg)
9
![Page 10: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/10.jpg)
10
Find group discussions about: movies
1. #MTOS
2. #FilmCurious
3. #DriveInMob
Sort by...
# tweets with “movie”?
Fraction of tweets with “movie”?
# users who tweet “movie”?
![Page 11: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/11.jpg)
11
Related Work
● Group Chats on Twitter
[CKM 2013]
Algorithms for finding group chats
This work: Ranking
![Page 12: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/12.jpg)
12
Related Work
● Group Chats on Twitter
[CKM 2013]
● Search in Online Forums
[Elsas, Carbonell 2009] [Cong et al. 2008]
Finding forum threads
This work: Finding discussion groups.
![Page 13: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/13.jpg)
13
Related Work
● Group Chats on Twitter
[CKM 2013]
● Search in Online Forums
[Elsas, Carbonell 2009] [Cong et al. 2008]
● PageRank [Brin, Page 1998], HITS [Kleinberg 1998]
![Page 14: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/14.jpg)
15
Sprockets
bob@
@
@
carol
alice#
#
#
sprockz
sprocketChat
talkSprockets
![Page 15: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/15.jpg)
16
Pr[#sprockz] = 0.2
Pr[#sprocketChat] = 0.5
Pr[#talkSprockets] = 0.3 #sprocketChat
#talkSprockets
#sprockz
Sprockets
Final Ranking:Stationary Distribution:
![Page 16: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/16.jpg)
17
M gh=λ1n+(1−λ)∑u
Agu Pguh
bob@
@
@
carol
alice#
#
#
sprockz
sprocketChat
talkSprockets0.7
0.1
0.2
0.1
0.6
0.3
Authority Scores Agu
Preference Scores Pguh
![Page 17: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/17.jpg)
18
M gh=λ Dh+(1−λ)∑uAgu Pguh
bob@
@
@
carol
alice#
#
#
sprockz
sprocketChat
talkSprockets
Authority Scores Agu
Preference Scores Pguh
Teleport Distribution Dh
![Page 18: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/18.jpg)
19
M gh=λ Dh+(1−λ)∑uAgu Pguh
Group Preference Model
DISCLAIMER:Use only for ranking.Not a model of reality.
πFind stationary distribution
π g>πhif g>hRank
![Page 19: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/19.jpg)
20
Group Preference Model @@
@###
Random Surfer Model(PageRank)
Hubs and Authorities
![Page 20: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/20.jpg)
21
Stability
![Page 21: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/21.jpg)
22
● PageRank and HITS are unstable.
● Our algorithm is also unstable.
Stability
small change in inputBIG CHANGE IN RANKING?
![Page 22: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/22.jpg)
23
StabilityTheorem
If we increase one user's preference for group A (at the expense of other groups) then A's rank will not go down.
@ABC
[Chien, Dwork, Kumar,Simon, Sivakumar 2003]
![Page 23: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/23.jpg)
25
Rank by # times query occurs?
dementia
![Page 24: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/24.jpg)
26
Rank by # times query occurs?
small groupfocused on dementia
big news hashtagdementia mentioned incidentally
dementia
![Page 25: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/25.jpg)
27
ExampleTheorem: Dementia chat ranked at top.*
dementia#
elder care#Alzheimer's#
news# V
*(Assuming the teleport distribution is uniform.)
![Page 26: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/26.jpg)
28
Evaluation
● # tweets with query● Fraction of tweets with query● # users who tweet with query
Baseline algorithms:
![Page 27: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/27.jpg)
29
Evaluation
● Queries
● Ground Truth
● Dataset of group discussions
![Page 28: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/28.jpg)
30
Evaluation: Dataset
One week of #MTOS
One year of tweets
Require at least 10 meetings
27K group discussions
![Page 29: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/29.jpg)
31
Evaluation: Queries
Noun Phrases(27 Million)
“someone”
“next week”
Yahoo! GroupsQueries
(five months)
2000 Test Queries
![Page 30: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/30.jpg)
32
Evaluation: Ground Truth
“Experts” — Query appears in profile text
2000 600 Queries Poor Quality
![Page 31: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/31.jpg)
33
Evaluation: Ground Truth
Algorithm 2Algorithm 1“Experts”
#### #
#
1. #2. #3. #
1. #2. #3. #
1. #2. #3. #
![Page 32: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/32.jpg)
34
Evaluation: Ground Truth
#### #
#
X
✓ X
✓
Evaluate by hand: 600 50 queries
![Page 33: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/33.jpg)
35
Results
Group Preference Model
# distinct users
# tweets
Fraction of tweets with query
(“Experts”)
Recall@5
0.49
0.28
0.36
0.38
(0.71)
Precision@5
0.40
0.24
0.31
0.27
(0.53)
![Page 34: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/34.jpg)
37
Computing Authority Scores
# @@
@
Recall@5
0.49
0.47
0.47
0.48
Method
# tweets with query
# @-mentions with query
# followers
uniform
Precision@5
0.40
0.38
0.38
0.40
![Page 35: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/35.jpg)
39
Summary
We designed the Group Preference Model, and found good theoretical and experimental results.
![Page 36: James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra · 2020-05-02 · 1 Ranking Twitter Discussion Groups James Cook Krishnaram Abhimanyu Das Kenthapadi Nina Mishra COSN 2014](https://reader034.vdocuments.us/reader034/viewer/2022050207/5f5a11a3461b5f35634337ac/html5/thumbnails/36.jpg)
40
Future Directions
● Which groups are easy to join?● Different types of query● Personalized ranking● Groups are always changing● Put it online!
Thanks!