![Page 1: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/1.jpg)
Knowledge from Crowds – Be1er with Ins6tu6ons + Algorithms h1p://goo.gl/q1DNL Shaun Abrahamson @shaunabe
![Page 2: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/2.jpg)
Tap the crowd for learning
![Page 3: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/3.jpg)
Where did Stanley come from?
![Page 4: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/4.jpg)
Crowd data recycled into knowledge
![Page 5: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/5.jpg)
Collec6ve contribu6ons into holis6c understanding
![Page 6: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/6.jpg)
Compe6ng for be1er predic6ons
![Page 7: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/7.jpg)
Our signals into rankings
![Page 8: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/8.jpg)
New type of ins6tu6on to deliver mobile services
![Page 9: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/9.jpg)
Labo
r
Capita
l
Assets
Influ
ence
Data
The crowd as the gateway to critical resources
![Page 10: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/10.jpg)
Sharing, Commenting, Reviewing Open Innovation, Co-Creation, Micro Tasks
Labo
r*
Capita
l
Assets
Influ
ence
Data
“Big Data”
* very often “knowledge” work
![Page 11: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/11.jpg)
Labo
r / Kn
owledge Work
Capita
l
Assets
Influ
ence
Data
Institutions vs Algorithms
![Page 12: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/12.jpg)
4 PERSPECTIVES!!
OUTCOMES!PEOPLE!TOOLS!
ORGANIZATION!
![Page 13: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/13.jpg)
OUTCOMES!
![Page 14: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/14.jpg)
Ronald Coase “Given that produc6on could be carried on without any organiza6on that is, firms at all, why and under what condi6ons should we expect firms to emerge?” About 75 years ago
Why do we organize work in a certain way?
![Page 15: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/15.jpg)
New Ins6tu6ons + tools
! Sales!
! Marketing! Operations! Production!R + D!
![Page 16: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/16.jpg)
New data + algorithms
! Sales!
! Marketing! Operations! Production!R + D!
![Page 17: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/17.jpg)
CASE:!What went wrong at Wikipedia?!
![Page 18: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/18.jpg)
Source: Mary Meeker presentation at All things D. ! The end of all other encyclopedia business models
![Page 19: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/19.jpg)
Why aren’t editors staying?
Active E
ditors R
eten
tion
afte
r 1 y
ear (
%)
![Page 20: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/20.jpg)
PEOPLE!!
FINDING AND MOTIVATING THE MOST IMPORTANT KNOWLEDGE RESOURCES!
![Page 21: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/21.jpg)
What skills might you tap into?
175 million people on !
![Page 22: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/22.jpg)
Why will they par6cipate?
Money!
Experience!Attention!
Good!
Stuff!
![Page 23: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/23.jpg)
What data by-‐products might you rely on?
![Page 24: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/24.jpg)
Why did you start contribu6ng to Wikipedia?
![Page 25: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/25.jpg)
What kind of work environment do you want ?
![Page 26: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/26.jpg)
ORGANIZATION!!
WHAT INSTITUTITIONS ARE CRITICAL TO BENEFIT
FROM CROWD LABOR + INFLUENCE!
![Page 27: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/27.jpg)
Elinor Ostrom “It's a problem, it's just not necessarily a tragedy ... The problem is that people can overuse [a shared resource], it can be destroyed, and it is a big challenge to figure out how to avoid that.” About 2 years ago
Organizing to resolve the “Tragedy of Commons”
![Page 28: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/28.jpg)
Who owns what? Brand vs IP vs Confiden6ality
![Page 29: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/29.jpg)
Cheap access to dispute resolu6on
![Page 30: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/30.jpg)
Collec6ve choice processes
![Page 31: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/31.jpg)
Sanc6on bad behavior -‐ Don’t feed the trolls
![Page 32: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/32.jpg)
Nes6ng to scale
![Page 33: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/33.jpg)
How Wikipedia community sees itself
The community's role, as some kind of nebulous science-‐fic6on super-‐en6ty, is to: + Organize and edit individual pages + Structure naviga6on between pages + Resolve conflict between individual members + Re-‐engineer itself -‐-‐ crea6ng rules and pa1erns of
behavior There are other roles J Source -‐ h1p://meta.wikimedia.org/wiki/The_Wikipedia_Community
![Page 34: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/34.jpg)
TOOLS!!!
COLLECTING DATA AND CREATING NEW UNDERSTANDING!
![Page 35: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/35.jpg)
Making it easier to contribute
![Page 36: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/36.jpg)
Understanding individual contribu6ons
My Klout! My Giving (Crowdtwist)!
My Creative Impact(Jovoto)!
![Page 37: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/37.jpg)
Understanding collec6ve health and performance
![Page 38: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/38.jpg)
Rocket Science vs People Science?
![Page 39: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/39.jpg)
Making sense of all that data
![Page 40: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/40.jpg)
Wikimedia founda6on’s focus People + Tools
![Page 41: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/41.jpg)
CASE: EDX.ORG!!
NEW EDUCATIONAL INSTITUTIONS !
+ !DATA TO GET SMARTER
ABOUT EDUCATION!
![Page 42: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/42.jpg)
Content + Community = Learning
![Page 43: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/43.jpg)
Represents about 40 years worth of classes at MIT
155,000 registered!23,000 tried the first problem set!9,000 passed the midterm!7,157 passed the course!
![Page 44: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/44.jpg)
Ricardo + Arthur doing “online learning”
![Page 45: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/45.jpg)
Community not just content
“One of the best things about 6.002x was the community built by the students themselves. The atmosphere was great: people shared their enthusiasm and knowledge, and lended a hand to those like me who didn’t have the basics for the course.” - Arthur Amaral, 18 years old, Brazil Source: http://blog.edx.org/
![Page 46: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/46.jpg)
Ins6tu6ons -‐ Nes6ng + Collec6ve Choice
![Page 47: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/47.jpg)
Anant Agarwal “We can watch how many a1empts students made before they got an exercise right, and if they got it wrong, what they used to try to find a solu6on. Did they go to the textbook, go back and watch the video, go to the forum and post a ques6on?” About 1 month ago
Data to learn how to teach
![Page 48: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/48.jpg)
CASE: GIFFGAFF [TELEFONICA]!
!NEW INSTITUTIONS!
TO BENEFIT FROM THE KNOWLEDGE OF !
CUSTOMERS!
![Page 49: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/49.jpg)
Social produc6on for a complex service
![Page 50: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/50.jpg)
Homepage hints at how this works
![Page 51: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/51.jpg)
What tasks can be performed?
![Page 52: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/52.jpg)
Who is doing what on GiffGaff
Value Created!
Income/Expenses!
! Sales!
! Marketing! Operations! Production!R + D!
![Page 53: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/53.jpg)
From sales + support to new app development
![Page 54: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/54.jpg)
Encouraging Par6cipa6on + Rewarding Behavior
![Page 55: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/55.jpg)
Self policing mechanisms
Gaming the system -‐ posts from users who you suspect are abusing the payback system by using mul6ple accounts to give themselves solu6ons or kudos. Tou0ng for SIMS/Kudos -‐ posts which are ac6vely asking for kudos or solu6ons, it is fine to have this in your signature but not to ask in a post/topic. Incorrect Accepted Solu0ons -‐ if you spot an accepted solu6on which is incorrect or if a user has accepted one of their own responses as a solu6on unjus6fiably. Incorrect Tags -‐ If you see that a post has been tagged with an irrelevant or inappropriate tag. Inappropriate Content -‐ Posts which are disrespecmul to other users, profanity, adver6sing, naming and shaming and generally causing discord or disharmony on the forum.
![Page 56: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/56.jpg)
How is this growing? Also NPS = 73 (Apple = 79)
![Page 57: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/57.jpg)
Labo
r / Kn
owledge Work
Capita
l
Assets
Influ
ence
Data
Institutions vs Algorithms
![Page 58: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/58.jpg)
Anant Agarwal “We can watch how many a1empts students made before they got an exercise right, and if they got it wrong, what they used to try to find a solu6on. Did they go to the textbook, go back and watch the video, go to the forum and post a ques6on?” About 1 month ago
Data + Algorithms for Knowledge Management
![Page 59: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/59.jpg)
Elinor Ostrom “It's a problem, it's just not necessarily a tragedy ... The problem is that people can overuse [a shared resource], it can be destroyed, and it is a big challenge to figure out how to avoid that.” About 2 years ago
Community + Institutions for Knowledge Management
![Page 60: Knowledge From Crowds - Better with Institutions + Algorithms](https://reader034.vdocuments.us/reader034/viewer/2022051412/54b528594a7959cf308b4672/html5/thumbnails/60.jpg)
Knowledge from Crowds – Be1er with Ins6tu6ons + Algorithms h1p://goo.gl/q1DNL Shaun Abrahamson @shaunabe