Slide 1

SOCIAL QUESTION ASKING DOES ANYONE WANT TO LEARN HOW TO GET QUESTIONS ANSWERED? Jaime Teevan with M. R. Morris, D. J. Liebling, K. Panovich, J. Yang, L. Adamic, M. Ackerman, B. Hecht, D. Gergle

Slide 2

? What should I talk about at dub?

Slide 3

Slide 4

Slide 5

Slide 6

Questions About Questions What questions do people ask their social network? What type of questions do people ask? About what? Which questions get answered? How can someone ask an effective question? Why do people ask questions of their network? What motivates question asking and answering? Why would someone ask versus search? How can tools help find the best answers?

Slide 7

What type of questions are asked about what? Which questions get answered? How can someone ask an effective question? What Question Do People Ask?

Slide 8

What Questions Do People Ask? What type of questions are asked about what?

Slide 9

Have you used a status message to ask a question? Frequency of asking, question types, responses received, why? Provide an example Have you answered a status message question? Why or why not? Provide an example Participants: 624 Microsoft employees Follow-up: 933 from four cultures (US, UK, China, India) Survey of Status Message Asking

Slide 10

Overview of Asking and Answering Asking status message questions Half of participants reported asking questions Answering status message questions 3 out of 4 participants had seen a question Almost all who had also answered questions Cultural variation in overall behavior China and India asked and answered more questions Questions seen as more important than in US and UK

Slide 11

Consistencies in Question Wording Questions short (75 characters, 1 sentence) 18.5% of phrased as a statement I need a recommendation on a good all purpose pair of sandals. Often scoped 1 out of 5 directed to anyone Anyone know of a good Windows 6 mobile phone that wont break the bank? Network subset Hey Seattle tweeps: Feel like karaoke on the Eastside tonight?

Slide 12

Social Network Question Topics Topic%Example Technology29%Anyone know if WOW works on Windows 7? Entertainment17%Was seeing Up in the theater worth the money? Home & Family12%So whats the going rate for the tooth fairy? Professional11% Which university is better for Masters? Cornell or Georgia Tech? Places8% Planning a trip to Whistler in the off-season. Recommendation on sites to see? Restaurants6%Hanging in Ballard tonight. Dinner recs? Current events5% What is your opinion on the recent proposition that was passed in California? Shopping5%Whats a good Mothers Day gift? Philosophy2%What would you do if you had a week to live? Missing: Health and Pornography M i s s i n g : H e a l t h a n d P o r n o g r a p h y Religion, Politics, Dating, Finance R e l i g i o n, P o l i t i c s, D a t i n g, F i n a n c e

Slide 13

Social Network Question Types Type%Example Recommendation29% Building a new playlist any ideas for good running songs? Opinion22% I am wondering if I should buy the Kitchen-Aid ice cream maker? Factual17% Anyone know a way to put Excel charts into LaTeX? Rhetorical14% Why are men so stupid? Invitation9% Who wants to go to Navya Lounge this evening? Favor4% Need a babysitter in a big way tonight anyone?? Social connection3% I am hiring in my team. Do you know anyone who would be interested? Offer1% Could any of my friends use boys size 4 jeans?

Slide 14

Questions Vary by Who Is Asking Type Recommendation Opinion Factual Rhetorical Invitation Favor Social connection Offer Topic Technology Entertainment Home & Family Professional Places Restaurants Current events Shopping Philosophy men women old young Twitter Facebook

Slide 15

Asking used more seriously by Asian cultures v. Western cultures Questions Vary by Who Is Asking Type Recommendation Opinion Factual Rhetorical Invitation Favor Social connection Offer Topic Technology Entertainment Home & Family Professional Places Restaurants Current events Shopping Philosophy

Slide 16

Types and Topics of Questions? Subjective questions on acceptable topics Popular topics: Technology, entertainment, family Popular types: Recommendations, opinions Questions vary by demographics and culture Which questions get answered?

Slide 17

Questions Get Good Answers Quantity: 94% of questions answered Quality: 69% of responses helpful Speed: 90% within a day (24% within 30 minutes) People expected faster responses But were satisfied with speed Answer quality varies with phrasing Shorter questions get more useful responses

Slide 18

Answer Quality Varies by Question Type Recommendation Opinion Factual Rhetorical Invitation Favor Social connection Offer Topic Technology Entertainment Home & Family Professional Places Restaurants Current events Shopping Philosophy Unhelpful No correlation Faster

Slide 19

Which Questions Get Answered? Subjective questions on acceptable topics Popular topics: Technology, entertainment, family Popular types: Recommendations, opinions Questions vary by demographics and culture Questions get many high quality answers quickly Correlated with phrasing Correlated with topic and type How can someone ask an effective question?

Slide 20

Controlled Study of Effective Asking Controlled experiment Many people ask the same question Compare responses Need generic question Topic: Entertainment Type: Opinion Should I watch E.T.?

Slide 21

Controlled Variables QuestionStatement 1 SentenceShould I watch E. T.? I wonder if I should watch E.T. 2 Sentences Taking it easy. Should I watch E.T.? Taking it easy. I wonder if I should watch E.T. Who posted the question Demographics Social network use and makeup Profile picture Time of day Question phrasing Length Punctuation Scoping

Slide 22

QuestionStatement 1 SentenceShould I watch E. T.? I wonder if I should watch E.T. 2 Sentences Taking it easy. Should I watch E.T.? Taking it easy. I wonder if I should watch E.T. Controlled Variables Who posted the question Demographics Social network use and makeup Profile picture Time of day Question phrasing Length Punctuation Scoping QuestionStatement 1 Sentence Does anyone think I should watch E. T.? I wonder if anyone thinks I should watch E.T. 2 Sentences Taking it easy. Does anyone think I should watch E.T.? Taking it easy. I wonder if anyone thinks I should watch E.T. Scope

Slide 23

Measuring the Responses Quantity % with responses # of responses Quality % answered, useful Response length Speed Time to first response Count QuantityQualitySpeed % with response # of responses % answered % useful Response length Time to first response Overall28282%3.259%72%561:27

Slide 24

Who Posted the Question Generally saw few significant differences Larger social networks give better answers More social profile picture get better answers Close shot Another person Count QuantityQualitySpeed % with response # of responses % answered % useful Response length Time to first response 20013375%2.650%63%54.92:15 201+14889%3.766%80%56.90:52

Slide 25

Afternoon questions Receive more answers faster Morning questions Receive longer responses Count QuantityQualitySpeed % with response # of responses % answered % useful Response length Time to first response Morning13884%2.852%74%61.91:50 Afternoon14380%3.665%70%49.81:05 Time of Day

Slide 26

Count QuantityQualitySpeed % with response # of responses % answered % useful Response length Time to first response 1 sentence15388%3.773%80%55.21:08 2 sentences12975%2.543%62%56.01:55 Count QuantityQualitySpeed % with response # of responses % answered % useful Response length Time to first response Question14381%3.464%80%56.91:25 Statement13976%3.054%63%54.01:30 Phrasing Length 1 sentence gets more high quality responses faster Punctuation Question get more (useful) responses than statements Scope Scoping the question helps even if just anyone Count QuantityQualitySpeed % with response # of responses % answered % useful Response length Time to first response None8978%2.654%63%43.81:37 Anyone9583%3.261%74%57.71:20 Movie buff9886%3.761%79%63.31:27

Slide 27

How Can Someone Ask Effectively? Subjective questions on acceptable topics Popular topics: Technology, entertainment, family Popular types: Recommendations, opinions Questions vary by demographics and culture Questions get many high quality answers quickly Correlated with phrasing Correlated with topic and type Can influence responses by how a question is asked Ask short questions of anyone in the afternoon

Slide 28

What Questions Do People Ask? Subjective questions on acceptable topics Popular topics: Technology, entertainment, family Popular types: Recommendations, opinions Questions vary by demographics and culture Questions get many high quality answers quickly Correlated with phrasing Correlated with topic and type Can influence responses by how a question is asked Ask short questions of anyone in the afternoon

Slide 29

What motivates question asking and answering? Why would someone ask versus search? How can tools help find the best answers? Why Do People Ask Questions?

Slide 30

What motivates question asking and answering?

Slide 31

Motivations for Asking Motive%Example Trust24.8%I trust my friends more than I trust strangers. Subjective21.5%Search engine can provide data but not an opinion. Thinks search would fail 15.2% Im pretty search engine couldnt answer a question of that nature. Audience14.9%Friends with kids, first hand real experience. Connect12.4%I wanted my friends to know I was asking the question. Speed6.6%Quick response time, no formalities. Context5.4%Friends know my tastes. Tried search5.4%I tried searching and didnt get good results. Easy5.4%Didnt want to look through multiple search results. Quality4.1%Human-vetted responses.

Slide 32

Motivations for Answering Motive%Example Altruism37.0Just trying to be helpful. Expertise31.9If Im an expert in the area. Question15.4Interest in the topic. Relationship13.7If I know and like the person. Connect13.5Keeps my network alive. Free time12.3Boredom/procrastination. Social capital10.5I will get help when I need it myself. Obligation5.4A tit-for-tat. Humor3.7I might have a witty response. Ego3.4Wish to seem knowledgeable.

Slide 33

Motivations for Answering Motive%Example Altruism37.0Just trying to be helpful. Expertise31.9If Im an expert in the area. Question15.4Interest in the topic. Relationship13.7If I know and like the person. Connect13.5Keeps my network alive. Free time12.3Boredom/procrastination. Social capital10.5I will get help when I need it myself. Obligation5.4A tit-for-tat. Humor3.7I might have a witty response. Ego3.4Wish to seem knowledgeable. Motives for Not Answering - Dont know the answer - Dont have time or interest M o t i v e s f o r N o t A n s w e r i n g - D o n t k n o w t h e a n s w e r - D o n t h a v e t i m e o r i n t e r e s t - Dont know the asker - D o n t k n o w t h e a s k e r

Slide 34

Why Do People Ask Questions? People motivated by trust and altruism Search often considered or tried Cultural differences: Entertainment v. social capital Why would someone ask versus search?

Slide 35

Information Need: Backsplash Re-Tiling Any tips for tiling a kitchen backsplash? kitchen re-tiling tips backsplash re-tiling kitchen remodel diy Study of Searching v. Asking

Slide 36

Task (as expressed to the social network) Is now looking for a new phone to get Any suggestions??? any tips for tiling a kitchen backsplash? Anyone know how to stop an in-car nav system from constantly rebooting???? Ugggggh Does anyone know how to train for half marathon? Linkstrainingdiet to follow would be great! Lauren's going away for a month, anyone know any good vegetarian recipes? Soafter getting the PMP, what else is anyone doing to keep up their development? should I wait for ZuneHD or buy Ipod touch (to gift someone)? is wanting to move away from Live Space for storing and sharing pictures Any recommendations? Can one defeat Seattle winter with a trip to New Zealand? Does anybody have the beta on bouldering there? is looking for recommendations (restaurants and activities) in Cancun is starting to plan my Thanksgiving trip to Disneylandwhat are the must see attractions, especially for a 3-year that loves princesses? Any websites out there for planning other than disneyland.com? Does anyone have any recommendations on a good medium to high end TV?

Slide 37

How People Searched v. Asked Task Time spent searching Time to first response Responses pre-search Total responses Phone Shopping3815320 Re-Tile Kitchen29837 Fix Car GPS461922 Half Marathon Training Tips2100 Vegetarian Recipes36 110 Career Development Advice14151902 Compare Zune and iPod Touch32713 Photo Storage Service1218405 Bouldering in New Zealand317705 Cancun Vacation49522 Disneyland Vacation228510 TV Shopping3400 On average, searchers Spent 30 minutes Issued 6.5 queries Visited 35.4 pages

Slide 38

Different Benefits for Each Approach Benefits of searching Received answers very quickly Could refine their query as they learned more Found content considered objective and unbiased Benefits of asking Auxiliary social benefits (awareness, connections) Answers highly personalized Received answers not encountered through search Answers encountered through validated

Slide 39

Why Ask v. Search? People motivated by trust and altruism Search often considered or tried Cultural differences: Entertainment v. social capital Searching and asking provide different benefits Searching is fast and can be refined Asking creates social connections, finds the unexpected How can tools help find the best answers?

Slide 40

Socially Embedded Search Engine How do people respond to search engines in their social spaces? H o w d o p e o p l e r e s p o n d t o s e a r c h e n g i n e s i n t h e i r s o c i a l s p a c e s ?

Slide 41

Hard Problems to Overcome Not always appropriate to respond Most status messages are for social discussion Questions can be rhetorical Can poop qualify as a character in a book? Coming up with a relevant answer is hard Relevance not the only factor to consider Social conformance also matters Your friends comments reflect on you Mentioning others can feel invasive

Slide 42

New Opportunities Extend existing search algorithms Lots of context available Answers do not need to be found immediately Interesting feedback mechanisms Humor and serendipity can outweigh relevance Link to the childrens book Everybody Poops Opportunity to shape the dialog Ask follow-up questions Influence friends responses

Slide 43

How Can Tools Help Answer? People motivated by trust and altruism Search often considered or tried Cultural differences: Entertainment v. social capital Searching and asking provide different benefits Searching is fast and can be refined Asking creates social connections, finds the unexpected Get both with algorithmic content in a social setting Social conformance important, can be collected in new ways Opportunity to influence friends responses

Slide 44

Answers About Questions What questions do people ask their social network? People ask subjective questions on acceptable topics Questions get many high quality answers quickly Can influence answers by how a question is asked Why do people ask questions of their network? People motivated by trust and altruism Searching and asking provide different benefits Get both with algorithmic responses in a social setting

Slide 45

M. R. Morris, J. Teevan, and K. Panovich. What Do People Ask Their Social Networks, and Why? A Survey Study of Status Message Q&A Behavior. In Proceedings of CHI 2010. J. Yang, M. R. Morris, J. Teevan, L. Adamic, and M. Ackerman. Culture Matters: A Survey Study of Social Q&A Behavior. In Proceedings of ICWSM 2011. J. Teevan, M. R. Morris, and K. Panovich. Factors Affecting Response Quantity, Quality and Speed in Questions Asked via Online Social Networks. In Proceedings of ICWSM 2011. M. R. Morris, J. Teevan, and K. Panovich. A Comparison of Information Seeking Using Search Engines and Social Networks. In Proceedings of ICWSM 2011. Questions?