prescore presentation by adam etkin for highwire fall 2013 meeting
DESCRIPTION
preSCORE, an organization formed to assist members of the scholarly publishing community who are committed to preserving an ethical, rigorous peer review process, was unveiled at the 2013 Fall Highwire meeting.TRANSCRIPT
![Page 1: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/1.jpg)
preSCOREpeer review evaluation SCORE –
A new set of metrics for today’s information ecosystem
![Page 2: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/2.jpg)
Traditional peer review seems to be under constant criticism
![Page 3: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/3.jpg)
Cases of faulty research being published seem to support the critics
![Page 4: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/4.jpg)
The recent Bohannon “sting” highlights the problem
![Page 5: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/5.jpg)
But this problem isn’t new & isn’t just an OA problem
It’s about Peer Review.
![Page 6: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/6.jpg)
What is preSCORE?
These are extreme examples which make news, however surveys indicate that most researchers value peer review. Different approaches are not easy to identify. preSCORE is a new tool that generates a metric indicating the level of peer review conducted.
Both article and journal level metrics are included in preSCORE.
![Page 7: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/7.jpg)
Creating a Different Metric
Calculated metric includes other “best practices” Not a lagging indicator, a leading indicator Newer initiatives such as altmetrics offer more immediate,
useful info, but this is also post-publication. We focus on pre-publication peer-review, which sets it apart from other metrics
Supports filtering and differentiation, both critical to readers and researchers
![Page 8: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/8.jpg)
Who Benefits?
Readers Authors Publishers/Journals Librarians
![Page 9: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/9.jpg)
How Does It Work?
Export tagged metadata from peer review system
Pull reviewer h-index from Thomson-Reuters Metadata and h-index analyzed by preSCORE,
and the score is calculated preSCORE passed as needed via API and
made available on journal page displays, within article metrics, and so on
![Page 10: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/10.jpg)
preSCORE and preVAL
preSCORE is the “heart” of the system Not focused on good/bad numbers preVAL answers the first, most basic
question…“Was this peer reviewed?” This allows users to drill in for more details if
they want Allows journals to share additional info
![Page 11: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/11.jpg)
Examples
![Page 12: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/12.jpg)
Drill Down for Details
![Page 13: preSCORE Presentation by Adam Etkin for Highwire Fall 2013 Meeting](https://reader035.vdocuments.us/reader035/viewer/2022062406/5592bc711a28abf9408b457f/html5/thumbnails/13.jpg)
Project Status
Currently completing development with ScholarOne and Aries
Beta testing underway Expect to launch in 2014 Anyone who would like more info OR
publishers/journals who wish to participate in beta testing, please contact me directly