13 0212 toccon - carpenter altmetrics 2
DESCRIPTION
Todd Carpenter presentation at the O'Reily Tools of Change conference TOCCON in New York, NY.TRANSCRIPT
![Page 1: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/1.jpg)
Alternative Metrics
How the future of assessment can improve discovery and delivery of
content
Todd Carpenter, Executive Director, NISOTools of Change Conference, New York, NY
February 12, 2013
Tuesday, February 12, 13
![Page 2: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/2.jpg)
@TAC_NISO Twitter Highlights• So excited to present on #altmetrics today during #tocfbf at #fbf12
• Again, I’m pre-tweeting my presentation. Slides to come! #tocfbf #fbf12
• #NISO = 1/3 Publishers, 1/3 Libraries, 1/3 automation suppliers. Communities converge to develop standards #tocfbf #fbf12
• Standards are everywhere in book publishing, we just don’t notice them anymore. #tocfbf #fbf12
• In 1955 Eugene Garfield published “Citation Indexes for Science” in Science http://bit.ly/xfylwh #tocfbf #fbf12
• Quote: “If I have seen further it is by standing on ye shoulders of Giants." Sir Isaac Newton #tocfbf #fbf12
• Sounds like beginning of a joke: 2 guys at Stanford, they wrote this paper, then started a company in a garage ... #tocfbf #fbf12
• Citations are awesome, aren’t they? A perfect solution to all the world’s problems, no? #tocfbf #fbf12
• Citations aren’t always a measure of quality. They are also a very lagging indicator of impact #tocfbf #fbf12
• #altmetrics a suite of assessment criteria & measures being developed to assess importance of a particular scholarly output #tocfbf #fbf12
• #altmetrics examples: usage analysis, metrics of non-traditional content, observational or behavioral analysis, social media #tocfbf #fbf12
• How 1 can apply #altmetrics Sell related content, spot trends in near-real-time, ID new fields or new services, marketing #tocfbf #fbf12
• Real world #altmetrics examples: http://bit.ly/OzGnGt www.tynt.com http://bit.ly/TcNIh0 http://bit.ly/PknZb4 #tocfbf #fbf12
• Issues needing consensus regarding #altmetrics - Authorship, provenance, definitions of components, privacy, openness #tocfbf #fbf12
Tuesday, February 12, 13
![Page 3: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/3.jpg)
• Non-profit industry trade association accredited by ANSI with 150+ members
• Mission of developing and maintaining technical standards related to information, documentation, discovery and distribution of published materials and media
• Volunteer driven organization: 400+ spread out across the world
• Responsible for standards like ISSN, DOI, Dublin Core metadata, DAISY digital talking books, OpenURL, MARC records, and ISBN (indirectly)
About
Tuesday, February 12, 13
![Page 4: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/4.jpg)
Image: DanTaylor Image: : Joel Washing
Standards are familiar, even if you don’t notice
Tuesday, February 12, 13
![Page 5: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/5.jpg)
Who is reading published content?
Tuesday, February 12, 13
![Page 6: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/6.jpg)
Who is reading published content?
Tuesday, February 12, 13
![Page 7: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/7.jpg)
We stand on the shoulders of giants...
Tuesday, February 12, 13
![Page 8: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/8.jpg)
The Mighty Citation
Tuesday, February 12, 13
![Page 9: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/9.jpg)
Impact factor
Tuesday, February 12, 13
![Page 10: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/10.jpg)
Thomson-Reuters IMPACT FACTOR
Tuesday, February 12, 13
![Page 11: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/11.jpg)
Two Stanford Students
Tuesday, February 12, 13
![Page 12: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/12.jpg)
They wrote a paper
Tuesday, February 12, 13
![Page 13: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/13.jpg)
They started a company in someone’s garage
Photo: APTuesday, February 12, 13
![Page 14: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/14.jpg)
Tuesday, February 12, 13
![Page 15: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/15.jpg)
Citations are awesome, aren’t they?
A perfect solution to all the world’s problems, no?
A simple conclusion can be drawn
Tuesday, February 12, 13
![Page 16: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/16.jpg)
“What Des-Cartes did was a good step. You have added much several ways, & especially in taking ye colours of thin plates into philosophical consideration. If I have seen further it is by standing on ye shoulders of Giants."
Back to Sir Isaac Newton
Tuesday, February 12, 13
![Page 17: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/17.jpg)
Citations aren’t always what we think they are
Caveat emptor
Tuesday, February 12, 13
![Page 18: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/18.jpg)
Another problem with citations
Tuesday, February 12, 13
![Page 19: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/19.jpg)
So where to from here?Tuesday, February 12, 13
![Page 20: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/20.jpg)
Define Altmetrics, Please
Tuesday, February 12, 13
![Page 21: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/21.jpg)
Usage Based Metrics
Tuesday, February 12, 13
![Page 22: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/22.jpg)
Image: Domenico, Caron, Davis, et al.
Citation of non-traditional content
Citations to new forms of communciation aren’t as simple as one might think.
Define a use of this?
Tuesday, February 12, 13
![Page 23: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/23.jpg)
Clickstream Analysis
Tuesday, February 12, 13
![Page 24: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/24.jpg)
Social Media Metrics
Image: Danny Brown, The State of Social Media Marketing 2012
Tuesday, February 12, 13
![Page 25: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/25.jpg)
Behavioral Metrics
Tuesday, February 12, 13
![Page 26: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/26.jpg)
Multivariate analysis
Tuesday, February 12, 13
![Page 27: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/27.jpg)
OK, it’s important, but what does it mean for
MY BUSINESS
Tuesday, February 12, 13
![Page 28: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/28.jpg)
Have you bought something from
Amazon?
Tuesday, February 12, 13
![Page 29: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/29.jpg)
Tuesday, February 12, 13
![Page 30: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/30.jpg)
Did you buy something that
“other people bought”?
Tuesday, February 12, 13
![Page 31: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/31.jpg)
Tuesday, February 12, 13
![Page 32: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/32.jpg)
Tuesday, February 12, 13
![Page 33: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/33.jpg)
$$$$ One Million Dollars $$$$
Tuesday, February 12, 13
![Page 34: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/34.jpg)
$$$$ One Million Dollars $$$$
Not
Implemented
Tuesday, February 12, 13
![Page 35: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/35.jpg)
Everything is a Recommendation
Netflix Recommendations: Beyond the 5 stars
Tuesday, February 12, 13
![Page 36: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/36.jpg)
What can Netflix glean from:
Several billion item ratingsItem popularity - along many axis
Stream plays each - along many axisMillions of “queue” additions daily
Rich item metadataUser interface interactions
Social dataExternal data
“All I see now is blonde, brunette, redhead”
Tuesday, February 12, 13
![Page 37: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/37.jpg)
Presenting movies is not the only game to play with these data
Tuesday, February 12, 13
![Page 38: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/38.jpg)
Innovation often takes place at the
intersection of different fields
Tuesday, February 12, 13
![Page 39: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/39.jpg)
Image: http://www.crispian.net/CrispiansScienceMap.html
Tuesday, February 12, 13
![Page 40: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/40.jpg)
Clickstream data yields high-resolution maps of science
Johan Bollen, Herbert Van de Sompel, et al. PLoS One, February 2009
Mapping the World of Science
Tuesday, February 12, 13
![Page 41: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/41.jpg)
Clickstream data yields high-resolution maps of science
Johan Bollen, Herbert Van de Sompel, et al. PLoS One, February 2009
Mapping the World of Science
Tuesday, February 12, 13
![Page 42: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/42.jpg)
So what else can I do?
Tuesday, February 12, 13
![Page 43: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/43.jpg)
Realtime Trend Spotting
Tuesday, February 12, 13
![Page 44: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/44.jpg)
Improve products and customer services
Tuesday, February 12, 13
![Page 45: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/45.jpg)
Editorial applications
Tuesday, February 12, 13
![Page 46: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/46.jpg)
Author services
(“How is my book doing?”)
Tuesday, February 12, 13
![Page 47: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/47.jpg)
Marketing applications
Tuesday, February 12, 13
![Page 48: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/48.jpg)
Is anyone really doing any of this?
(Beyond Amazon, Google & Netflix?)
Tuesday, February 12, 13
![Page 49: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/49.jpg)
Tuesday, February 12, 13
![Page 50: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/50.jpg)
70%
Tuesday, February 12, 13
![Page 51: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/51.jpg)
Tuesday, February 12, 13
![Page 52: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/52.jpg)
Tuesday, February 12, 13
![Page 53: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/53.jpg)
Tuesday, February 12, 13
![Page 54: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/54.jpg)
Issues we face with alternative metrics
Tuesday, February 12, 13
![Page 55: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/55.jpg)
Image: Flickr user karindalziel
Tuesday, February 12, 13
![Page 56: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/56.jpg)
Authorship-----
Disambiguation
Contributor Roles
Tuesday, February 12, 13
![Page 57: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/57.jpg)
Basic Definitions Needed
(So we are all talking about the same thing)
Tuesday, February 12, 13
![Page 58: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/58.jpg)
More open exchange of component data
Tuesday, February 12, 13
![Page 59: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/59.jpg)
Large Amounts of DataGood Analysts
Implementation StrategyCreativityStandards
(we can only do so much)
All you need is....
Tuesday, February 12, 13
![Page 60: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/60.jpg)
One Very Last Thing…
Image from Will Lion: http://www.flickr.com/photos/will-lion/2646213692/
Tuesday, February 12, 13
![Page 61: 13 0212 toccon - carpenter altmetrics 2](https://reader030.vdocuments.us/reader030/viewer/2022020306/5556da0bd8b42ac60c8b45d8/html5/thumbnails/61.jpg)
Thank you!
Todd Carpenter, Executive [email protected]
National Information Standards Organization (NISO)3600 Clipper Mill Road, Suite 302
Baltimore, MD 21211 USA+1 (301) 654-2512
www.niso.org
Tuesday, February 12, 13