social query: a query routing system for twitter

Social Query A Query Routing System for Twitter

Cleyton Souza Jonathas Magalhães, Evandro Costa, and Joseana Fechine

Laboratory of Artificial Intelligence – LIA

Federal University of Campina Grande - UFCG

Introduction

• Query Routing (QR) is the process of directing questions to appropriate responders

– Community Question and Answering Services (CQA)

– Online Social Networks (OSN)

• We are proposing an Expertise Finding System to automatically routing questions on Social Networks

Cleyton Souza - ICIW 2013 2

Introduction

• Our goal is to present the Social Query System • How does it work?

• How does the usual Q&A process is affected?

• Talk about our preliminary results

• Talk about our planning for the future

Cleyton Souza - ICIW 2013 3

Agenda

• Introduction

• Related Work & Background

• Usual Q&A

• Social Query System: How it works

• Evaluation & Results

• Future Work

Cleyton Souza - ICIW 2013 4

Related Work & Background

• The differential of our research

– We are proposing a Query Routing to an OSN context

• Previous work usually focused on CQA context

• We are proposing a solution to a pre-existent and popular context: Twitter

• Most part of questions asked on Twitter are not answered (more than 80%) [Paul et al. 2012]

– We lead with the recommendation as multi-criteria decision making problem

• Previous work usually apply probabilistic or Information Retrieval-based models;

Cleyton Souza - ICIW 2013 5

Usual Q&A on OSN

• Sharing a public question

Fig. 1: Sharing a Public Question

Cleyton Souza - ICIW 2013 6

Q&A on OSN

• Directing the question

Fig. 2: Directing the Question

Cleyton Souza - ICIW 2013 7

Q&A on OSN

• Routing the question

Fig. 3: Routing the Question

Cleyton Souza - ICIW 2013 8

Social Query System

• Works outside Twitter

– Questioner’s Followers are Expert Candidates

– Questions and Answers without size limitations

Fig. 4: Social Query System’s Homepage Cleyton Souza - ICIW 2013 9

“New Question” Page

• Three text fields, two mandatory

Fig. 5: “New Question” Page Cleyton Souza - ICIW 2013 10

“Recommendation List” Page

• Questioner chooses who will “receive” the question

Fig. 6: “Recommendation List” Page

Cleyton Souza - ICIW 2013 11

Question’s Tweet

• Questioner tweets the following message

Fig. 7: Question’s Tweet

Cleyton Souza - ICIW 2013 12

“New Answer” Page

• Three options of answer

Fig. 8: “New Answer” Page Cleyton Souza - ICIW 2013 13

“I don’t Know” & “I know Someone”

Fig. 9: “I don’t know” Tweet

Fig. 10: “I know someone” Tweet

Cleyton Souza - ICIW 2013 14

I want answer

• When the expert clicks on the “I want answer” button

Fig. 11: “I want answer” Page Cleyton Souza - ICIW 2013 15

Tweeting about the Answer

Fig. 12: “I just answered” Tweet

Cleyton Souza - ICIW 2013 16

“New Evaluation” Page

Fig. 12: “New Evaluation” `Page

Cleyton Souza - ICIW 2013 17

How does it work?

• (1) The questioner accesses our System and (2) informs his question;

• (3) The System recommends potential responders and (4) the questioner chooses to whom direct the question;

• (5) Those chosen access our System, (6) answers the question, (7) and informs the questioner about his answer;

• (8) The questioner access our System, (9) see the answer, and (10) evaluates it.

Cleyton Souza - ICIW 2013 18

Evaluation

• Nine Volunteers evaluated ten recommendations for a couple of questions

a) Looking for a new band to listen during weekend, does anyone have an indication?

b) Going to the movie theater after years LOL. What is the best movie in theaters?

• Each recommendation was labeled as good (relevance 1), neutral (relevance 0) and bad (relevance 0).

• These labels reflect the opinion of the volunteers about the recommendation

Cleyton Souza - ICIW 2013 19

Results

Cases Amount of Followers

% of good %of bad nDCG

Best case for Question “a” 192 50% 10% 0.63

Worst case for Question “a” 129 30% 60% 0.25

Best case for Question “b” 121 60% 0% 0.74

Worst case for Question “b” 68 30% 0% 0.18

Average for Question “a” 110 41% 28% 0.41

Average for Question “b” 110 50% 20% 0.51

Cleyton Souza - ICIW 2013 20

Future Work

• Where are we?

• Mobile App

• Volunteer’s feedback

– Follow Back Filter

– Thesaurus

• Real case study

Cleyton Souza - ICIW 2013 21

Social Query System A System for Query Routing on Twitter

Cleyton Souza Jonathas Magalhães, Evandro Costa, and Joseana Fechine

Laboratory of Artificial Intelligence – LIA

Federal University of Campina Grande - UFCG

Thank You!

Lia TIPS Laboratory of Artificial

Intelligence Group of Intelligent Social and

Customizable Technologies