crowd sourcing of library services
DESCRIPTION
2014 Charleston Conference Charleston Neapolitan Session Saturday, Nov 8, 9:45 AMTRANSCRIPT
![Page 1: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/1.jpg)
Crowd Sourcing of Reference and User
Services
John G. DoveFormer CEO, Credo
Scott JohnsonCEO, ChiliFresh
Tim SpauldingFounder, LibraryThing
Ilana Barnes StonebrakerAsssitant Professor of Library Science, Purdue University
Saturday November 8, 2014 9:45-10:45 AM
Colonial Ballroom, Francis Marion Hotel
![Page 2: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/2.jpg)
2
Crowdsourcing
A venerable history in libraries.
E. G. the National Union Catalogs
National Union Catalog photo by Boatwright Memorial Library https://www.flickr.com/photos/boatwrightlibrary/6899675938/
![Page 3: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/3.jpg)
3
Wikipedia
![Page 4: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/4.jpg)
4
Oxford English Dictionary
![Page 5: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/5.jpg)
5
Central to Crowdsource Strategies
• Three major challenges:– Distinguishing between good and mediocre
contributions, i.e.: Curation– Systematic Biases– The Update Problem
![Page 6: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/6.jpg)
6
Scalable Curation
How to get Wisdom? Rather than Madness?
![Page 7: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/7.jpg)
7
To Get Wisdom
James Surowiecki Three Main Factors
• Independence of contributing groups
• A fair way to sum-up the contributions
• No systematic biases
![Page 8: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/8.jpg)
8
Condorcet Jury TheoremCass Sunstein Decision Theory
• If each member scores at least 50% group score converges on 100%.
• The darkside? If each member scores 49% the group score converges on zero!!
![Page 9: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/9.jpg)
9
Wisdom vs. Madness
Wikipedia How does it measure up?
![Page 10: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/10.jpg)
10
2 examples of curated collaboration
Birds of North America
Encyclopedia of Life
![Page 11: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/11.jpg)
11
The Update Problem
• Or: How to put the “Crowd” into “Crowd Sourcing”?
• What % needs to contribute meaningfully into order to create the necessary value?
• Eg. Zagat, Yelp• Otherwise you have an electronic ghost-
town
![Page 12: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/12.jpg)
12
For each of these panelists
• Have they solved the Update problem?• Have they found an effective way to scale
up the curation of the content?• Have they avoided the problem of
systematic biases?
![Page 13: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/13.jpg)
LibraryThing and the
Ladder of Engagement
Tim SpaldingCharleston Conference 2014
[email protected]@LibraryThingTim
![Page 14: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/14.jpg)
What is LibraryThing?
• Personal cataloging• Social cataloging• Social networking• (Also makes products for libraries.)
![Page 15: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/15.jpg)
The Ladder of Engagement
• How people “climb” the site• Shows qualitative differences in types of
crowdsourcing• Suggests model for “adding”
crowdsourcing
![Page 16: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/16.jpg)
The Ladder of Engagement
• Personal cataloging • Exhibitionism, voyeurism• Self-expression• Social cataloging• Policing and helping• Collaborative cataloging
![Page 17: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/17.jpg)
![Page 18: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/18.jpg)
112m tags added
![Page 19: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/19.jpg)
![Page 20: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/20.jpg)
393 covers for Harry Potter and the Sorcerer’s Stone
4 million covers across the site
![Page 21: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/21.jpg)
The Ladder of Engagement
• Personal cataloging • Exhibitionism, voyeurism• Self-expression• Social cataloging• Policing and helping• Collaborative cataloging
![Page 22: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/22.jpg)
The Ladder of Engagement
• Personal cataloging • Exhibitionism, voyeurism• Self-expression• Social cataloging• Policing and helping• Collaborative cataloging
![Page 23: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/23.jpg)
The Ladder of Engagement
• Personal cataloging • Exhibitionism, voyeurism• Self-expression• Social cataloging• Policing and helping• Collaborative cataloging
![Page 24: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/24.jpg)
• 2.3 million reviews
• 830k “unique” works reviewed
![Page 25: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/25.jpg)
The Ladder of Engagement
• Personal cataloging • Exhibitionism, voyeurism• Self-expression• Social cataloging (cataloging on shared data)• Policing and helping• Collaborative cataloging
![Page 26: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/26.jpg)
![Page 27: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/27.jpg)
• 6.4m edits
![Page 28: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/28.jpg)
All “Authority Control”
•Work-edition control (more than 4m acts of disambiguation)
• Author combination/separation• Homonymous author division• Tag disambiguation
Does it work? Like all get-out.
![Page 29: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/29.jpg)
![Page 30: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/30.jpg)
The Ladder of Engagement
• Personal cataloging • Exhibitionism, voyeurism• Self-expression• Social cataloging• Policing and helping• Collaborative cataloging
![Page 31: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/31.jpg)
The Ladder of Engagement
• Personal cataloging • Exhibitionism, voyeurism• Self-expression• Social cataloging• Policing and helping• Collaborative cataloging
![Page 32: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/32.jpg)
![Page 33: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/33.jpg)
The Ladder of Engagement
• Personal -> social• Love of the thing -> love of other• Love of self -> altruistic• Done be low-interest people -> high-
interest• Done by many -> done by few– This is a good thing.
![Page 34: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/34.jpg)
Lessons from the Ladder
• Secure the bottom of the ladder• Build it rung-by-rung?• Consider it rung-by-rung• Crowdsourcing is not a “feature”
Above all:• It’s not about what you GET• It’s about what you GIVE
![Page 36: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/36.jpg)
ChiliFresh
A Global Community At Your Local Library
![Page 37: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/37.jpg)
Community
• Before the Internet – Community was a geographic space– You could ride your bicycle around your
community– Your work place was also part of your
community
• Because of the Internet – Community is not define by geographics– Vocation– Hobbies– Literary Interests
![Page 38: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/38.jpg)
Information
• The Power of Opinion• Collaborative Data• The Voice of The Crowd• A Valuable Message OR Noise?
![Page 39: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/39.jpg)
![Page 40: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/40.jpg)
![Page 41: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/41.jpg)
![Page 42: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/42.jpg)
![Page 43: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/43.jpg)
![Page 44: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/44.jpg)
![Page 45: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/45.jpg)
Interactivity where your Users “live”
• Mobile Apps (iOS & Android)– Full catalog search– Notifications– Review and Social Aggregation
• Facebook App– Full catalog search– Like/share– Review and Social Aggregation
![Page 46: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/46.jpg)
Your Library’s Ecosphere
• LMS Agnostic• Single-sign on• Local Connection with Global Reach
![Page 47: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/47.jpg)
Crowdsourcing, Libraries And Reference:
CrowdAsk
Ilana StonebrakerAssistant Professor of Library ScienceBusiness Information SpecialistNovember 8th, 2014
![Page 49: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/49.jpg)
How is your library like 54 jokes in 4 minutes?
![Page 50: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/50.jpg)
![Page 51: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/51.jpg)
Your library supports (online) community
![Page 52: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/52.jpg)
Some (online) communities your library may support
• Your city• Your school or organization• Your alumnae or retirement base• Your “fans”• Your collection strengths
![Page 53: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/53.jpg)
4 Not Shocking Facts
1. Everyone uses the internet more now than before for a variety of purposes and reasons.
2. Our patrons are part of the community in which we serve but also participate.
3. Students don’t read the manual.4. The majority of reference questions
are lower level.
![Page 54: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/54.jpg)
What is supposed to happen
Students develop
questions about
resources, which they ask
a librarian about.
The librarian answers the
question dazzlingly well.
Student rocks project, get
amazing job, loves library for
life.
![Page 55: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/55.jpg)
What actually happens
![Page 56: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/56.jpg)
Challenges
• Reference service model flawed
Librarians
Other Student
s
Friends Professo
r
![Page 57: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/57.jpg)
Challenges
Questions are all treated alike• Majority of reference questions are lower
level• Questions are context-based• The process of reference decontextualizing
then has to add context in the reference interview process- inefficient
• Lack of utilization of other information sources such as graduate students, instructors
We live in an information ecosystem
![Page 58: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/58.jpg)
Crowdsourcing
Crowdsourcing is an “online distributed problem-solving and production model that leverages the collective intelligence of online communities to serve specific organizational goals.”
![Page 59: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/59.jpg)
Crowdsourcing
In crowdsourcing, the “locus of control regarding the creative production of goods and ideas exists between the organization and public, a shared process of bottom-up, open creation by the crowd and top-down management by those charged with serving an organization’s strategic interests.”
![Page 60: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/60.jpg)
Community: Students, Staff and Faculty of Purdue UniversitySpecific Goal: Provide Contextual Answers for Student and Alumnae Questions, teaching students how to ask better questions and strengthening alumnae networks.
![Page 61: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/61.jpg)
![Page 62: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/62.jpg)
![Page 63: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/63.jpg)
![Page 64: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/64.jpg)
![Page 65: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/65.jpg)
![Page 66: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/66.jpg)
![Page 67: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/67.jpg)
CrowdAsk on Purdue Website
• Systems statistics– 129 users posted questions, 184
answered questions– 257 voted– 316 questions, 700 answers– Most views on a question: 182– Most answers to a question: 16– Most votes on a question: 48
![Page 68: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/68.jpg)
Quantitative Assessment- Students
• Google Analytics (January 5, 2014 to April 2, 2014)– 1,150 visits from 474 unique visitors– 14,715 page views
• average 12.8 pages per visit.
– 6 minutes and 7 seconds average visit duration.
![Page 69: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/69.jpg)
• Usability Test of 4 students (2 novice and 2 expert)
• Motivation for expert users: reciprocity, not points
CrowdAsk- Usability Tests
![Page 70: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/70.jpg)
Launch on Purdue Libraries Website
Goal: develop sustainable user engagement and community involvement as part of the Purdue University Libraries website.
![Page 71: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/71.jpg)
Crowds are your communities.
![Page 72: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/72.jpg)
Keys for Crowdsourcing Reference
• The stronger the online community, the stronger the answer base
• Crowdsourcing can also strengthen online community by bringing people together for common goals
• Reciprocity is important to these communities. They need to give as well as take.
![Page 73: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/73.jpg)
How could you use CrowdAsk?
Where are theOpportunities?
Where are the possibleThreats or Weakness?
Where are the possibleBenefits?
![Page 74: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/74.jpg)
Thank YouCrowdAsk codehttps://github.com/crowdask0/crowdask
Short video on CrowdAskhttp://youtu.be/-kaNIPJ82yA
Ilana StonebrakerBusiness Information SpecialistPurdue University [email protected]
Tao Zhang, PhDDigital User Experience SpecialistPurdue University [email protected]
![Page 75: Crowd Sourcing of Library Services](https://reader038.vdocuments.us/reader038/viewer/2022102902/558a2f81d8b42ac85d8b46b2/html5/thumbnails/75.jpg)
Works cited and Image Credit
• Bishop, B. W., & Bartlett, J. A. (2013). Where Do We Go from Here? Informing Academic Library Staffing through Reference Transaction Analysis. College & Research Libraries, 74(5), 489-500.
• Brabham, Daren C. (2013), Crowdsourcing, MIT Press.pg 1• http
://static.guim.co.uk/sys-images/Money/Consumer/financialservicesbrochures/2014/2/28/1393599196845/Angry-man-about-to-throw--011.jpg