argumentative discussions on the web ifip 2012-10-13
DESCRIPTION
Talk to the IFIP meeting www.ifip.or.at/bulletin/bulltcs/tc12_aim.htm#wg127TRANSCRIPT
Copyright 2011 Digital Enterprise Research Institute. All rights reserved.
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Argumentative Discussions on the Web
Jodi SchneiderDigital Enterprise Research Institute, NUI Galway
Social Networking Semantics and Collective Intelligence working group, International Federation for Information Processing.
Galway, Ireland Saturday 13 th October 2012
1
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Argumentation is everywhere!
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Argumentation is everywhere!
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Argumentation is everywhere!
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Argumentation is everywhere!
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Argumentation is everywhere!
April 20, 2012London Argumentation Forum
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Identifying arguments is hard.
7,000 hours[Metzinger 1999]
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Approaches
User support Logical formalisms Theoretical approaches
9
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
User Support
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Example problems
Issue a press release responding to Tweet complaints Decide whether to delete a Wikipedia article Based on reviews, determine controversial product
features that customers both like & dislike.
11
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Represent Twitter complaints.
12
Jodi Schneider
Make sense of deletion discussions
Deletion Discussions in Wikipedia: Decision Factors and OutcomesJodi Schneider, Alexandre Passant & Stefan Decker
WikiSym 2012
Factor Example (used to justify `keep')
Notability Anyone covered by another encyclopedic reference is considered notable enough for inclusion in Wikipedia.
Sources Basic information about this album at a minimum is certainly verifiable, it's a major label release, and a highly notable band.
Maintenance …this article is savable but at its current state, needs a lot of improvement.
Bias It is by no means spam (it does not promote the products).
Other I'm advocating a blanket "hangon" for all articles on newly- drafted players
Deletion Discussions in Wikipedia: Decision Factors and OutcomesJodi Schneider, Alexandre Passant & Stefan Decker
WikiSym 2012
Decision Factors for Deleting Articles in Wikipedia
Alternative Interfaces for Deletion Discussions in Wikipedia: Some Proposals Using Decision Factors. [Demo]” Jodi Schneider and Krystian Samp WikiSym2012
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Find argumentation in reviews
Highlight terms: Premises, Positive sentiment, Domain properties
Semi-Automated Argumentative Analysis of Online Product ReviewsAdam Wyner, Jodi Schneider, Katie Atkinson and Trevor Bench-Capon
COMMA 2012
Annotate possible arguments
Identifying Consumers' Arguments in TextJodi Schneider & Adam Wyner,
SWAIE at EKAW 2012
Find arguments by searching annotations
19
Don’t need flash
Identifying Consumers' Arguments in TextJodi Schneider & Adam Wyner,
SWAIE at EKAW 2012
20
Flash badly placed
Identifying Consumers' Arguments in TextJodi Schneider & Adam Wyner
SWAIE at EKAW 2012
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Simple Reasoning Pattern
Premises: The Canon SX220 has good video quality. Good video quality promotes image
quality for casual photographers.
Conclusion: Casual photographers should buy the
Canon SX220.
21
Identifying Consumers' Arguments in TextJodi Schneider & Adam Wyner,
SWAIE at EKAW 2012
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Argumentation Scheme
Premises: The <camera> has <feature>. <feature> promotes <user value> for <user
class>.
Conclusion: <user class> should <e-commerce action>
the <camera>. <e-commerce action>: buy, not buy, sell, return, …
22
Identifying Consumers' Arguments in TextJodi Schneider & Adam Wyner,
SWAIE at EKAW 2012
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Variables as Targets for Information Extraction
<camera><property><user value><user type><e-commerce action>
23
Identifying Consumers' Arguments in TextJodi Schneider & Adam Wyner, SWAIE at EKAW 2012
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Logical formalisms
Argumentation Schemes Argument Frameworks Assumption-based, Admissible Argumentation (ABBA)
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Formal Representations
Argumentation Schemes Appeal to Expert Opinion Appeal to Popular Opinion From Analogy Slippery Slope ....
Indicate Relevant “Critical Questions” for a discussion Patterns for Information Extraction
(Amazon examples - SWAIE 2012)
John Danaher, http://philosophicaldisquisitions.blogspot.ie/2010/03/argumentation-schemes-part-1.html
Identifying Consumers' Arguments in TextJodi Schneider & Adam Wyner,
SWAIE at EKAW 2012
Search annotations to fill slots in argumentation scheme
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Argumentation Frameworks
Example
Variety of Semantics – can be used to choose best options Dung 1995
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Transform Debates into Argument Frameworks
(1) Households should pay tax for their garbage.
(4) (1) Paying tax for garbage increases recycling, so households should pay.
(3) (1)Recycling more is good, so people
should pay tax for their garbage.
29
Arrow: premise
Wyner, van Engers, & BahreiniFrom Policy-making Statements to First-order Logic. EGOV 2010
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Calculate best options (non-contradictory opinions)
30
Wyner, van Engers, & Bahreini. From Policy-making Statements to First-order Logic. EGOV 2010
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Assumption-based, Admissible Argumentation
Deductive system with inference rules Assumptions “Backward argument” – Argument Tree
Reasoning on the Web with Assumption-Based ArgumentationFrancesca ToniReasoning Web Summer School
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
From a Facebook thread to logic
Toni & TorroniBottom-Up ArgumentationTAFFA 2011
Comment “This is what my kitchen tap used to look like…”
Opinion “Separate taps are common in GB”
Links “This is what my kitchen tap used to look like…”
supports “Separate taps are common in GB”
Toni & TorroniBottom-Up ArgumentationTAFFA 2011
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Map the conversation
Toni & TorroniBottom-Up ArgumentationTAFFA 2011
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
objectsTo link
Links “Separate taps are inconvenient because they freeze/ burn hands”
objectsTo “Separate taps are not inconvenient as basin solves temperature problem”
Toni & TorroniBottom-Up ArgumentationTAFFA 2011
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Logical framework
Assumption-Based Argumentation basedOn(o3) ← c2, l_3_2
36
Toni & TorroniBottom-Up ArgumentationTAFFA 2011
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Logical framework
Assumption-Based Argumentation alink(l_4_17,o4,o17)
37
Toni & TorroniBottom-Up ArgumentationTAFFA 2011
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Theories
Popularity isn’t everything Walton & Krabbe’s Dialogue Types Dimensions of Argumentative Expression
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Numbers aren’t everything
overwhelming numbers of people may not matter
Photograph DAVID GILES/PA NEWS WIRE/AP PHOTO - February 7, 2011 New Yorker via http://www.vincentskeltis.com/blog/2011/2/7/crowd-crush.html
Dimensions of Argumentation in Social MediaJodi Schneider, Brian Davis, and Adam WynerEKAW 2012
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
What’s the Support?
The overall popularity of an opinion is not as important as the reasons supporting it
Image: http://www.nickmilton.com/2012/03/when-people-trust-crowds.html
Dimensions of Argumentation in Social MediaJodi Schneider, Brian Davis, and Adam WynerEKAW 2012
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Discussion purpose: Walton & Krabbe’s dialogue types
41
Commitment in Dialogue: Basic Concepts of Interpersonal ReasoningWalton & Krabbe1995
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Dimensions of (Argumentative) Expression
Genre Metadata Properties of users Goals of a particular dialogue Context Informal language Implicit info Sentiment techniques Subjectivity and objectivity
Dimensions of Argumentation in Social MediaJodi Schneider, Brian Davis, and Adam WynerEKAW 2012
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Acknowledgments
Thanks to our collaborators! Katie Atkinson, Trevor Bench-Capon, Adam Wyner (Liverpool) DERI Social Software Unit & others Rhetorical Structure Taskforce, W3C Health Care/Life Sciences
My Funding Science Foundation Ireland Grant No. SFI/08/CE/I1380 (Líon-2) Short-term scientific mission (STSM 1868) from the COST Action
ICO801 on Agreement Technologies SFI Short Term Travel Fellowship
43
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Thanks!
Questions?
Jodi Schneider
@jschneider
45http://en.wikipedia.org/wiki/Wikipedia:Articles_for_deletion/Heath_Totten
Digital Enterprise Research Institute www.deri.ie
Enabling Networked Knowledge
Arguments
Claim: does not merit an articleJustification: hasn’t played
since 2008, mediocre record
46