interacting with social media content about events
DESCRIPTION
Talk at CWI workshop, Amsterdam.TRANSCRIPT
![Page 1: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/1.jpg)
interacting with social media content about events
Mor Naaman
Rutgers SC&I
![Page 2: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/2.jpg)
social media information lab?
![Page 3: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/3.jpg)
social media research:
1. what are people doing (and why)?
![Page 4: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/4.jpg)
social media research:
2. understanding social systems at scale
![Page 5: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/5.jpg)
social media research:
3. creating new experiences
![Page 6: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/6.jpg)
events in social media
![Page 7: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/7.jpg)
![Page 8: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/8.jpg)
BYOBW
![Page 9: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/9.jpg)
Vox Civitas: reasoning about events with social media content
Multiplayer: organizing social multimedia content from live events
evaluating social multimedia experiences ov
ervi
ew
![Page 10: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/10.jpg)
social multimedia
![Page 11: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/11.jpg)
social multimedia
online sources of multimedia content posted in settings that foster significant individual participation and that promote community curation, discussion and re-use of content.
![Page 12: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/12.jpg)
social multimedia on Twitter
![Page 13: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/13.jpg)
“media’s conversational shadow”
- @ayman
![Page 14: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/14.jpg)
research questions
how can (Twitter) content contributed around large-scale broadcast news events inform journalistic inquiry?
what kinds of insights and analyses are enabled through visual analytic tools?
how to build better tools to support journalistic inquiry?
![Page 15: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/15.jpg)
“Hey Fellas, have a look
at this scoop I just pulled from TWITTER.”!
![Page 16: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/16.jpg)
designing for journalism
what would a journalist ask of Twitter?
tendency to cover “decisive moments”, divergent points of view, audience criticism/applause
newsworthiness: favors surprising, unusual, good / bad
useful indicators: – sentiment: applause, criticism, controversy, good /
bad – response magnitude: quotes, topics / issues – unique / novel contributions
![Page 17: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/17.jpg)
supporting analysis
direct attention to relevant information
automatic content analysis for filtering – relevance – uniqueness / novelty – sentiment – keyword extraction
![Page 18: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/18.jpg)
vox civitas
![Page 19: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/19.jpg)
Nicholas Diakopoulos, Mor Naaman, Funda Kivran-Swain,
Diamonds in the Rough: Social Media Visual Analytics for Journalistic Inquiry (VAST 2010)
http://sm.rutgers.edu/vox
![Page 20: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/20.jpg)
Vox Civitas: reasoning about events with social media content
Multiplayer: organizing social multimedia content from live events
evaluating social multimedia experiences ov
ervi
ew
![Page 21: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/21.jpg)
social multimedia
![Page 22: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/22.jpg)
social multimedia on YouTube
![Page 23: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/23.jpg)
![Page 24: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/24.jpg)
![Page 25: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/25.jpg)
![Page 26: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/26.jpg)
![Page 27: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/27.jpg)
research questions
how can we transform the consumption of video content created by users attending large-scale events?
what kinds of practices and user tasks can be enabled through a new experience?
how to build better tools to leverage the social context of video capture?
![Page 28: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/28.jpg)
Lyndon Kennedy and Mor Naaman. Less Talk, More Rock (WWW 2009)
![Page 29: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/29.jpg)
![Page 30: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/30.jpg)
1 master’s student
3 months
![Page 31: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/31.jpg)
relive with YouTube
Multiplayer (w/ Coco)
![Page 32: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/32.jpg)
multiple perspectives:
relevance
no redundancy
improves as content added
leverages social metadata
![Page 33: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/33.jpg)
Nicholas Diakopoulos, Mor Naaman, Tayebeh Yazdani, Zihao Yu. Navigating Events in a Multi-Perspective Social Video Browser (in submission)
![Page 34: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/34.jpg)
Vox Civitas: reasoning about events with social media content
Multiplayer: organizing social multimedia content from live events
evaluating social multimedia experiences ov
ervi
ew
![Page 35: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/35.jpg)
challenge: evaluate!
![Page 36: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/36.jpg)
challenge: evaluate!
produce insights about use and usefulness that go beyond a specific implementation
![Page 37: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/37.jpg)
challenge: evaluate!
what are the di!erent factors that are in play when users interact with the new application?
![Page 38: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/38.jpg)
challenge: evaluate!
how do users perceive and understand the presentation and interaction mode?
![Page 39: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/39.jpg)
challenge: evaluate!
how does the new experience help (or hinder) users in performing tasks?
![Page 40: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/40.jpg)
two-pronged approach
directly evaluate the output of the algorithms (quantitative)
deep, extensive evaluation of the users interaction with the system or interactive prototype (qualitative) in the context of their task
read more: Olsen (UIST ’07); Naaman (MTAP ’10)
![Page 41: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/41.jpg)
Multiplayer study goals
what utility is provided to event content consumption?
how users interact with a multi-perspective videos from an event?
![Page 42: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/42.jpg)
laboratory study
two tasks/scenarios: – seen a show, reminisce/share – considering a show, checking it out
data collected – think-aloud data – detailed, open-ended questionnaire – Interaction logging
![Page 43: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/43.jpg)
data analysis
themes extracted from notes, transcripts
logging data examined for support
![Page 44: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/44.jpg)
insights: event viewing
seeing all activities on stage
“There’s a lot of activities on stage ... normally I would not be able to see everything at once and this allows me to do that”
![Page 45: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/45.jpg)
insights: event viewing
“being there”
“get an idea of what it’d be like to be in the audience”
“This preview is better than a seating chart!”
![Page 46: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/46.jpg)
insights: interaction
thumbnails natural, timeline not so much
audio switching problematic
![Page 47: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/47.jpg)
insights: taking control
users expressed need, desire to generate new media artifacts
If I really like a certain performance then I’d set it up as a mini-editor to have a super-customized version of this great event”
![Page 48: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/48.jpg)
Vox study goals
how do journalists use Vox Civitas and what is its journalistic utility?
what features do journalists interact with?
what kinds of insights does Vox Civitas support?
![Page 49: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/49.jpg)
online study
deployment scenario/task:: – “use the tool to develop two story pitches for
the event”
data collected – detailed, open-ended questionnaires – interface logging
participants – 15 / 18 with training in journalism
![Page 50: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/50.jpg)
data analysis
themes extracted from answers to questionnaire
types of story angles
logging data examined for support
![Page 51: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/51.jpg)
insights: utility
ideas for follow-up; mechanism to find sources
“figure out what statement resonated the most with the public”
“used as a compliment to stories that include more sound data”
![Page 52: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/52.jpg)
insights: story angles
audience response in multiple scales – individual – aggregate volume, sentiment
![Page 53: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/53.jpg)
insight: using search
Keyword searches and filtering helped find story angles
“Further investigation into statistics on college loan debt. How much are students carrying? And how long does it take to pay o!?”
![Page 54: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/54.jpg)
insight: using search
Keyword searches and filtering helped find story angles
““I chose the keyword ‘overseas’. This gave me more of mixed emotions for the audience due to the slash in tax breaks being given to companies who ship their jobs overseas”
![Page 55: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/55.jpg)
created new experiences for social media content from/about events
evaluations resulted in insights that are not necessarily tied to particular implementation sum
mar
y
![Page 56: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/56.jpg)
joint work with superstars:
Nicholas Diakopoulos
Funda Kivran-Swaine
Tayebeh Yazdani
Zihao Yu
than
ks to…
![Page 57: interacting with social media content about events](https://reader033.vdocuments.us/reader033/viewer/2022051514/5496e733b47959564d8b510c/html5/thumbnails/57.jpg)
mornaaman.com
@informor
join us at rutgers SMIL
(email me or introduce yourself)
than
k yo
u