collective intelligence meets the political agenda
DESCRIPTION
The Web is changing the way citizens engage with the political agenda. Following the emergence of social media, political events are now surrounded by real-time reactions and analyses from viewers, political actors, mainstream media and other social organisations. We anticipate a future in which events such as election debates will be enriched by an unpredictable range of additional information streams from individuals and organisations, from additional live reaction as events unfold, to retrospectively added resources which can be more reflective, and hence possibly higher quality. The EPSRC Electoral Debate Visualisation (EDV) Project is aimed at developing an online video replay platform during the 2015 UK General Election, in which party leadership debates are linked to customisable visualisation channels to enhance viewers’ experience and hopefully encourage citizen engagement.TRANSCRIPT
![Page 1: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/1.jpg)
Collective Intelligence Meets the Political Agenda:
Enhancing Election Debates to Foster Viewers' Engagement
edv-project.net
Brian Plüss
Anna De Liddo
Simon Buckingham Shum
![Page 2: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/2.jpg)
Simon Buckingham Shum
Professor
Learning Informatics
Anna De Liddo
Research Associate
Collective Intelligence
Brian Plüss
Research Associate
Debate Analytics
Paul Wilson
Lecturer
Design
Giles Moss
Lecturer
Media Policy
Stephen Coleman
Professor
Political Communication
![Page 3: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/3.jpg)
Leeds & OU research
on the 2010 Election Debates
![Page 4: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/4.jpg)
Univ. Leeds prior research into
public response to the
televised 2010 Election
Debates
![Page 5: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/5.jpg)
Impact of the 3 debates on
voter intentions
![Page 6: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/6.jpg)
Key findings…
• the British public appreciated the debates
• 2/3 said they’d learnt something new
• they seemed to energise first-time voters
• people would talk about them afterwards
(esp. younger voters)
• media coverage shifted from focusing on
the ‘game’ to the substance
![Page 7: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/7.jpg)
Mapping the UK election TV debates
http://people.kmi.open.ac.uk/sbs/2010/04/real-time-mapping-election-tv-debates
![Page 8: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/8.jpg)
Mapping the UK election TV debates
http://people.kmi.open.ac.uk/sbs/2010/04/real-time-mapping-election-tv-debates
Seeing Nick Clegg’s moves
![Page 9: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/9.jpg)
The EDV Project
2013-2016
![Page 10: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/10.jpg)
Focus groups motivate a set of
‘democratic entitlements’
• Ability to scrutinise the communicational strategies adopted by the speakers, e.g. to detect intentional confusion & manipulation
• Understand the meaning, background and
historical record of political claims
• Connect disparate arguments and claims with a
view to understanding their ramifications, esp.
negative
• Have a sense of involvement, presence and
voice, including telling their stories
![Page 11: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/11.jpg)
The debate-viewing
experience today
![Page 12: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/12.jpg)
The Clegg-Farage 2014 debates on UK-EU relations
BBC, 2 AprilLBC Radio, 26 March
![Page 13: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/13.jpg)
The Clegg-Farage 2014 debates on UK-EU
relations
![Page 14: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/14.jpg)
The Clegg-Farage 2014 debates on UK-EU
relations
![Page 15: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/15.jpg)
The Clegg-Farage 2014 debates on UK-EU
relations
![Page 16: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/16.jpg)
The Clegg-Farage 2014 debates on UK-EU
relations
![Page 17: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/17.jpg)
The Clegg-Farage 2014 debates on UK-EU
relations
![Page 18: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/18.jpg)
The Clegg-Farage 2014 debates on UK-EU
relations
![Page 19: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/19.jpg)
Fact-checking
• https://fullfact.org/
• Knowledge base
• Live fact-checking
• …
Full Fact (@FullFact)
Independent fact checking organisation
![Page 20: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/20.jpg)
BBC Live site
![Page 21: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/21.jpg)
The Future of
Election Debate Replays
![Page 22: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/22.jpg)
![Page 23: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/23.jpg)
Replay
Platform
![Page 24: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/24.jpg)
Debate Analytics and
Visualisations
• Argument Maps
• Rhetoric and Rules of the Game
Collaborations might make possible:
• Social Media Analytics
• Fact-Checking
• Topic Analysis
![Page 26: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/26.jpg)
![Page 27: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/27.jpg)
Collaborative
Knowledge
Production
Collaborative Web
Annotation and
Knowledge
mapping
Social Network
Analysis and
Visualization
Structured Online
Discussion and
Argumentation
Advanced Analytics for:
Attention mediation &
Deliberation diagnostic
http://catalyst-fp7.eu
Collective Argument Mapping and
Visualisation
Collective intelligence
for social innovation
![Page 28: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/28.jpg)
Rhetoric and Rules of the Game(Non-Cooperation in Dialogue)
![Page 29: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/29.jpg)
Rhetoric and Rules of the Game(Non-Cooperation in Dialogue)
![Page 30: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/30.jpg)
Rhetoric and Rules of the Game(Non-Cooperation in Dialogue)
• Rules of the game in terms of discourse
obligations
• Coding scheme for manual annotation of
transcripts
• Method for classifying annotated speaker
contributions wrt the rules of the game
![Page 31: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/31.jpg)
Rhetoric and Rules of the Game(Non-Cooperation in Dialogue)
Dialogue Act
Initiating Responsive
Init-Inform Init-InfoReq Resp-Inform Resp-Accept Resp-Reject
Objective Subjective
On-Topic Off-Topic
Accurate Inaccurate
New Repeated
Neutral Loaded
On-Topic Off-Topic
Reasonable Unreasonable
New Repeated
Objective Subjective
Relevant Irrelevant
Accurate Inaccurate
New Repeated
Complete Incomplete
• Rules of the game in terms of discourse
obligations
• Coding scheme for manual annotation of
transcripts
• Method for classifying annotated speaker
contributions wrt the rules of the game
![Page 32: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/32.jpg)
Rhetoric and Rules of the Game(Non-Cooperation in Dialogue)
Annotation Tool
![Page 33: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/33.jpg)
Rhetoric and Rules of the Game(Non-Cooperation in Dialogue)
Dialogue Act
Initiating Responsive
Init-Inform Init-InfoReq Resp-Inform Resp-Accept Resp-Reject
Objective Subjective
On-Topic Off-Topic
Accurate Inaccurate
New Repeated
Neutral Loaded
On-Topic Off-Topic
Reasonable Unreasonable
New Repeated
Objective Subjective
Relevant Irrelevant
Accurate Inaccurate
New Repeated
Complete Incomplete
• Rules of the game in terms of discourse
obligations
• Coding scheme for manual annotation of
transcripts
• Method for classifying annotated speaker
contributions wrt the rules of the game
![Page 34: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/34.jpg)
Rhetoric and Rules of the Game(Non-Cooperation in Dialogue)
![Page 35: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/35.jpg)
Rhetoric and Rules of the Game(Non-Cooperation in Dialogue)
Dialogue Act
Initiating Responsive
Init-Inform Init-InfoReq Resp-Inform Resp-Accept Resp-Reject
Objective Subjective
On-Topic Off-Topic
Accurate Inaccurate
New Repeated
Neutral Loaded
On-Topic Off-Topic
Reasonable Unreasonable
New Repeated
Objective Subjective
Relevant Irrelevant
Accurate Inaccurate
New Repeated
Complete Incomplete
• Is there room for crowdsourcing these?
![Page 36: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/36.jpg)
Citizen Voice Channels
• Viewer Feedback
And later perhaps…
• Crowdsourced Fact-Checking
• Life stories
![Page 37: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/37.jpg)
Citizen Voice Channels
• Viewer Feedback
And later perhaps…
• Crowdsourced Fact-Checking
• Life stories
• Everything?
![Page 38: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/38.jpg)
What if viewers had a say?
![Page 39: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/39.jpg)
What if viewers had a say?
‘Soft’ Feedback
![Page 40: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/40.jpg)
What if viewers had a say?
• Controlled and nuanced
• Voluntary and non-intrusive
• Enabling analytics and
visualisations
‘Soft’ Feedback:
![Page 41: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/41.jpg)
What if viewers had a say?
• Controlled and nuanced
• Voluntary and non-intrusive
• Enabling analytics and
visualisations
‘Soft’ Feedback:
![Page 42: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/42.jpg)
A paper prototype: the flashcard experiment
• 18 flashcards in 3 categories
• Emotion
• Trust
• Information need
• 15 participants watched the
second Clegg-Farage debate live
• Video annotations in Compendium
(and Youtube!)
![Page 43: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/43.jpg)
A paper prototype: the flashcard experiment
Emotion cards
![Page 44: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/44.jpg)
A paper prototype: the flashcard experiment
Trust cards
![Page 45: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/45.jpg)
A paper prototype: the flashcard experiment
Information need cards
![Page 46: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/46.jpg)
A paper prototype: the flashcard experiment
• 18 flashcards in 3 categories
• Emotion
• Trust
• Information need
• 15 participants watched the
second Clegg-Farage debate live
• Video annotations in Compendium
(and Youtube!)
![Page 47: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/47.jpg)
A paper prototype: the flashcard experiment
![Page 48: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/48.jpg)
A paper prototype: the flashcard experiment
• 18 flashcards in 3 categories
• Emotion
• Trust
• Information need
• 15 participants watched the
second Clegg-Farage debate live
• Video annotations in Compendium
(and Youtube!)
![Page 49: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/49.jpg)
A paper prototype: the flashcard experiment
Compendium Annotations
• Video mapping with modifications
• Annotations exported as XML,
CSV, etc. for analysis
• Youtube export for dissemination
• Replay of annotated videos
![Page 50: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/50.jpg)
A paper prototype: the flashcard experiment
Qualtitative analysis:
• Engagement with the cards
• Ease of use
• Peer pressure
Quantitative analysis:
• Most/least frequently used cards
• Most/least frequently used categories
• Comparison with other feedback
elicitation methods
![Page 51: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/51.jpg)
A paper prototype: the flashcard experiment
Outcomes:
• Test of hypothesis on categories
• Scalability
• Revision of the card deck
• Get insights for the design of the
platform feedback interface
![Page 52: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/52.jpg)
A digital prototype
![Page 53: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/53.jpg)
Debate Replay Platform
• Uniformly organise diverse sources
of information
• Support user preferences in terms
of:
• Visualisation channels
• Media navigation and indexing
• Allow for different kinds of audience
response
![Page 54: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/54.jpg)
EDV
Replay
Platform
![Page 55: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/55.jpg)
Generation of:
- Web content
- Analytics
- Open data
- ...
Repository
Replay Website
GO!
Argument Mapping
Open Data
Video TranscriptsTwitter Feeds
SoftFeedback System
Rhetoric and Rules Checking
DebateRules
TopicsNon-Cooperation
Arguments Fact checking
Open Data
Sentiment Analysis
PartyManifestos
Topic Analysis
Soft FeedbackAnalysis
Fact-Checking
Soft Feedback
EDV Architecture Sketch
• Gather data from sources
• Analyse data and produce visualisations
• Tailor augmentations to audiences and purposes
• Publish open data and replay interface
• Provide access to citizens and give them a ‘voice’
Features and functionalities:
![Page 56: Collective Intelligence Meets the Political Agenda](https://reader034.vdocuments.us/reader034/viewer/2022042700/55941b821a28abfc2b8b469b/html5/thumbnails/56.jpg)
Thanks for your time!
Brian Plüss
Anna De Liddo
Simon Buckingham Shum
Knowledge Media Institute
The Open University, UK
http://edv-project.net/