katrina panovich
DESCRIPTION
CSCW2012 submission - see http://katrina.is for more information about my work and the paper this work is from.TRANSCRIPT
Tie Strength in Question & Answer on Social Network SitesKatrina Panovich @katrina_with Rob Miller & David KargerMIT CSAIL
1
1Wednesday, February 15, 12
2
what song was in this commercial?
2Wednesday, February 15, 12
3
3Wednesday, February 15, 12
4
4Wednesday, February 15, 12
5
5Wednesday, February 15, 12
6
I want to switch to linux full time but need a better music player. Any leads on one that can handle upwards of 500gb of files?
6Wednesday, February 15, 12
social q&a raban and harper 2008harper, raban, rafaeli, konstan 2008
ackerman and palen 1996
social search evans and chi 2008pirolli 2009
social networks lampe and ellison 2008
7
related work
7Wednesday, February 15, 12
50.6% had used their status message to ask a question of their social network before
Morris, M. R., Teevan, J., Panovich, K. What Do People Ask Their Social Networks, and Why?
CHI 2010.
8
8Wednesday, February 15, 12
recommendation
opnion
factual knowledge
rhetorical
invitation
favor
social connection
offer
technologyentertainmenthome & family
professionalplaces
restaurantscurrent events
shoppingethics and philosopy
29% Recommendation 29% Technology
9
Morris, M. R., Teevan, J., Panovich, K. What Do People Ask Their Social Networks, and Why?
CHI 2010.
9Wednesday, February 15, 12
How well do you know this person?
Median 4 out of 5
Morris, M. R., Teevan, J., Panovich, K.A Comparison of Information Seeking Using
Search Engines and Social Networks. ICWSM 2010.
10
10Wednesday, February 15, 12
11
11Wednesday, February 15, 12
12
tie strength:measure of the strength of a friendship
12Wednesday, February 15, 12
Granovetter, M. American Journal of Sociology, May 1973.
13
The Strength of Weak Ties
weak ties travel in different circles & know more diverse information
13Wednesday, February 15, 12
The Strength of Weak Ties
weak ties travel in different circles & know more diverse information
Granovetter, M. American Journal of Sociology, May 1973.
14
14Wednesday, February 15, 12
weak ties...
- cited at least 19,302 times
- can help us get jobs
- provide us with bridging social capital
- know diverse information
- are our extended community
- can introduce serendipity
15
15Wednesday, February 15, 12
research questions
16
16Wednesday, February 15, 12
research question 1
17
Does tie strength have the same ‘strength of
weak ties’ effect in this case?
17Wednesday, February 15, 12
How does the relation between tie strength and answer quality
play out?
18
research question 2
18Wednesday, February 15, 12
study overview
- participants asked questions
- we surveyed them about the responses they got
- regression analysis of tie strength vs answer qualities
19
19Wednesday, February 15, 12
20
strong ties...
provide answers we value more in general
provide already-known information less
contribute to overall knowledge more
20Wednesday, February 15, 12
methodology
21
21Wednesday, February 15, 12
?
22
participants asked tech recommendation questions
22Wednesday, February 15, 12
?
23
23Wednesday, February 15, 12
19 participants
24
?
24Wednesday, February 15, 12
does anyone have a good camera to recommend? size-wise, i'm looking for something between a giant DSLR and a tiny point-and-shoot
25
25Wednesday, February 15, 12
anyone flown delta? good? bad?
26
26Wednesday, February 15, 12
19 participants104 responsesall answered
median 3 responses
27
27Wednesday, February 15, 12
28
28Wednesday, February 15, 12
29
how close each friendship was
29Wednesday, February 15, 12
Days since last commDays since first commIntimacy x Structural
Wall words exchangedMean ts of mutual friends
Educational differenceStructural x Structural
Reciprocal Serv. x Reciprocal
Participant-init wall postsInbox thread depth
Participant’s no. of friendsInbox pos. emotion wordsSocial Distance x Structural
Participant’s no. of appsWall intimacy words
Gilbert & Karahalios CHI ’09Predicting Tie Strength with Social Media
30
30Wednesday, February 15, 12
31
Days since last commDays since first commIntimacy x Structural
Wall words exchangedMean ts of mutual friends
Educational differenceStructural x Structural
Reciprocal Serv. x Reciprocal
Participant-init wall postsInbox thread depth
Participant’s no. of friendsInbox pos. emotion wordsSocial Distance x Structural
Participant’s no. of appsWall intimacy words
31Wednesday, February 15, 12
32
Days since last communication
Days since first communication
Wall words exchanged
Mean tie strength of mutual friends
Participant’s number of friends
Inbox positive emotion words
Wall intimacy words
32Wednesday, February 15, 12
33
How strong is your relationship with this person?
r = 0.50
33Wednesday, February 15, 12
tie strengths ofall friends of all participants
34
Tie Strength
Freq
uenc
y
0.0 0.2 0.4 0.6 0.8 1.0
0500
1000
1500
2000
2500
34Wednesday, February 15, 12
tie strengths offriends who answered questions
35
0.0 0.2 0.4 0.6 0.8 1.0
05
1015
2025
30
Tie Strength
Freq
uen
cy
35Wednesday, February 15, 12
all friends all answerers
36
0.0 0.2 0.4 0.6 0.8 1.00
510
1520
2530
Tie Strength
Freq
uen
cy
Tie Strength
Freq
uenc
y
0.0 0.2 0.4 0.6 0.8 1.0
0500
1000
1500
2000
2500
36Wednesday, February 15, 12
answer quality
37
37Wednesday, February 15, 12
1. content
2. novelty of the information
3. person
38
unpacking answer quality
38Wednesday, February 15, 12
1. content
2. novelty of the information
3. person
39
unpacking answer quality
content
39Wednesday, February 15, 12
1. content
2. novelty of the information
3. person
40
unpacking answer quality
novelty
40Wednesday, February 15, 12
1. content
2. novelty of the information
3. person
41
unpacking answer quality
person
41Wednesday, February 15, 12
how on topic is this answer?
42
content
42Wednesday, February 15, 12
how supportive is this answer?
43
content
43Wednesday, February 15, 12
how interesting is this answer?
content
44Wednesday, February 15, 12
how much do you trust this answer?
45
content
45Wednesday, February 15, 12
how much does this answer provide novel information?
novelty
46Wednesday, February 15, 12
how much does this answer verify information you already knew?
47
novelty
47Wednesday, February 15, 12
how much does this answer contribute to your
overall knowledge?
48
novelty
48Wednesday, February 15, 12
how knowledgeable is this person about this topic?
49
person
49Wednesday, February 15, 12
what value do you generally place on answers from this person?
50
person
50Wednesday, February 15, 12
tie strength vs
answer quality
51
linear regression results
51Wednesday, February 15, 12
Top
ic
In
tere
stin
g
Su
pp
orti
ve
Know
led
geab
le
N
ovel
Tru
st
Ove
rall
Alr
ead
y
Val
ue
52
52Wednesday, February 15, 12
how much does this answer verify information you already knew?
how much does this answer contribute to your overall knowledge?
what value do you generally place on answers from this person?
Ove
rall
Alr
ead
y
Val
ue
53
53Wednesday, February 15, 12
0.0 0.2 0.4 0.6 0.8 1.0
23
45
67
Tie Strength and Value
What value do you generally place on answers from this person?
Tie Strength
Value
tie strength and value of this friend’s answers
R2 = 0.065β = 0.071p < 0.05
54
54Wednesday, February 15, 12
0.0 0.2 0.4 0.6 0.8 1.0
23
45
67
Tie Strength and Value
What value do you generally place on answers from this person?
Tie Strength
Value
tie strength and value of this friend’s answers
R2 = 0.065β = 0.071p < 0.05
55
Closer friends provide answers we value more in general.
55Wednesday, February 15, 12
tie strength and already known information
0.0 0.2 0.4 0.6 0.8 1.0
12
34
56
7
Tie Strength and Already Known Information
How much does this answer verify information you already knew?
Tie Strength
Knew
Already
R2 = 0.062β = –0.038p < 0.01
56
56Wednesday, February 15, 12
tie strength and already known information
0.0 0.2 0.4 0.6 0.8 1.0
12
34
56
7
Tie Strength and Already Known Information
How much does this answer verify information you already knew?
Tie Strength
Knew
Already
R2 = 0.062β = –0.038p < 0.01
57
Closer friends were less likely to provide information that the participant already knew.
57Wednesday, February 15, 12
tie strength and overall knowledge
0.0 0.2 0.4 0.6 0.8 1.0
12
34
56
7
Tie Strength and Overall Knowledge
How much does this answer contribute to your overall knowledge?
Tie Strength
Overa
ll K
now
ledge R2 = 0.036
β = 0.031p < 0.05
58
58Wednesday, February 15, 12
tie strength and overall knowledge
0.0 0.2 0.4 0.6 0.8 1.0
12
34
56
7
Tie Strength and Overall Knowledge
How much does this answer contribute to your overall knowledge?
Tie Strength
Overa
ll K
now
ledge R2 = 0.036
β = 0.031p < 0.05
59
Closer friends’ answers that are more likely to contribute to our overall knowledge.
59Wednesday, February 15, 12
correlations between quality metrics
60
60Wednesday, February 15, 12
How on topic was this answer?
How knowledgeable is this person about this topic?
How supportive is this answer?
How much do you trust this answer?
β = 0.51
0.60
0.48
61
61Wednesday, February 15, 12
How knowledgeable/trustworthy is this friend about this topic?
How on topic is this answer?
What value do you generally place on answers from this person?
How supportive is this answer?
0.35
0.44
0.43
62
62Wednesday, February 15, 12
tie strength
expertise
63
63Wednesday, February 15, 12
tie strength
expertise
64
64Wednesday, February 15, 12
I look for answers where people didn’t just recommend a product but gave reasons from
their experience or pointed to reviews
online.65
65Wednesday, February 15, 12
I guess a lot of evaluating is my
estimation of the source reliability (the person).
66
66Wednesday, February 15, 12
[It’s] just kind of a personal experience
with products that I’m looking for.
...
67
67Wednesday, February 15, 12
For example, I know [0.06] does a lot of camera work, and
[0.718] is a professional photographer, so I
value their answers more.
68
68Wednesday, February 15, 12
here’s where tie strength matters
69
value overall knowledge already known info
and here’s where it doesn’t.
on topic knowledgeable about topic supportive
interesting novel information trust
69Wednesday, February 15, 12
implications
70
70Wednesday, February 15, 12
Horowitz, D., Kamvar, S. The anatomy of a large-scale social search engine. WWW 2010.71
71Wednesday, February 15, 12
Horowitz, D., Kamvar, S. The anatomy of a large-scale social search engine. WWW 2010.72
72Wednesday, February 15, 12
Horowitz, D., Kamvar, S. The anatomy of a large-scale social search engine. WWW 2010.73
73Wednesday, February 15, 12
limitations
74
74Wednesday, February 15, 12
75
75Wednesday, February 15, 12
76
76Wednesday, February 15, 12
Does tie strength have the same ‘strength of weak ties’ effect in this case?
How does the relation between tie strength and answer quality play out?
77
77Wednesday, February 15, 12
when they mattered at all, stronger ties were actually slightly better
78
78Wednesday, February 15, 12
tie strength
expertise
79
79Wednesday, February 15, 12
thank you
Greg Vargas, Karrie Karahalios, Mark Ackerman
UID and Haystack groups
our participants
Xerox, NSF, Google
reviewers
80
80Wednesday, February 15, 12
Tie Strength in Question & Answer on Social Network Sites
Katrina Panovich MIT CSAILhttp://katrina.is
Ove
rall
Alr
ead
y
Val
ue
strong ties > weak tiesexpertise > tie strength
81
81Wednesday, February 15, 12