liangjie hong , zaihan yang and brian d. davison computer science and engineering
DESCRIPTION
Incorporating Participant Reputation in Community-driven Question Answering Systems. Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering Lehigh University Bethlehem, PA USA. Liangjie Hong, Zaihan Yang and Brian D. Davison. Why - PowerPoint PPT PresentationTRANSCRIPT
Incorporating Participant Reputation in Community-driven Question Answering Systems
Liangjie Hong, Zaihan Yang and Brian D. DavisonComputer Science and Engineering
Lehigh UniversityBethlehem, PA USA
Liangjie Hong, Zaihan Yang and Brian D. Davison
Why Community-driven Question & Answering ?
SIN August 2009
Liangjie Hong, Zaihan Yang and Brian D. Davison
Why Community-driven Question & Answering ?
SIN August 2009
• natural language vs. short queries
Liangjie Hong, Zaihan Yang and Brian D. Davison
Why Community-driven Question & Answering ?
SIN August 2009
• natural language vs. short queries• best answers vs. relevance
Liangjie Hong, Zaihan Yang and Brian D. Davison
Why Community-driven Question & Answering ?
SIN August 2009
• natural language vs. short queries• best answers vs. relevance• user interactions!
Liangjie Hong, Zaihan Yang and Brian D. Davison
Why Community-driven Question & Answering ?
SIN August 2009
• natural language vs. short queries• best answers vs. relevance• user interactions!• 23 millions resolved questions!
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
1 – 10 of 17, 702
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Resolved
Resolved
Resolved
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Earth Science & Geology
Physics
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Problems
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
• same or similar questions• different category• different time
Problems
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Problems
Read them all?Trust them all?
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Finding high quality answers
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Finding high quality answers
• content• user reputation
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Finding high quality answers
• content• user reputation
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
HITS-like scheme
User
User
User
User
User
User
User
Answerer
Questioner
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
HITS-like scheme
User
User
User
User
User
User
User
questioner - hubanswerer - authority
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
PageRank-like schemeUser
User User
User
User
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
PageRank-like schemeUser
User User
User
User
random jump ?
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
PageRank-like schemeUser
User User User
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
PageRank-like schemeUser
User User User
probability of interaction
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Incorporating topics
Profile
User
UserUser Profile
Profile
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Incorporating topics
UserUser
User
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Incorporating topics
α -> stay1- α -> jump topic
UserUser
User
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Incorporating topics
α -> stay1- α -> jump topic
d -> follow link1-d -> random jump User
User
User
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Incorporating topics
User
UserUser
α -> stay1- α -> jump topic
d -> follow link1-d -> random jump
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Other heuristics• Z-score
• Linear combination
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Dataset & Evaluation• Yahoo Answers!
14,122 questions + 45,814 answers12,731 users
• Strict & Relaxed Precision@1, MRR, Precision@10, MAP
• BM25 + User Reputation
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Strict Evaluation
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Relaxed Evaluation
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
Relaxed Evaluation
Liangjie Hong, Zaihan Yang and Brian D. Davison
SIN August 2009
• user reputation helps retrieval• topic modeling makes sense but…
• question answering• link direction
Conclusion
SIN August 2009
Thank you!Questions?
Contact Info:Liangjie [email protected] LaboratoryComputer Science and EngineeringLehigh UniversityBethlehem, PA 18015 USA
Liangjie Hong, Zaihan Yang and Brian D. Davison