academic publishing is evolving… 349 years of journal publishing what’s coming in the next ten?...

Post on 24-Dec-2015

220 Views

Category:

Documents

0 Downloads

Preview:

Click to see full reader

TRANSCRIPT

Academic Publishing is Evolving…

349 Years of Journal PublishingWhat’s Coming in the Next Ten?

Evolution or Revolution?

Pete Binfield Co-Founder & Publisher PeerJ

Wisconsin Maddison

10/30/2014

@ThePeerJwww.PeerJ.com

@p_binfieldpete@peerj.com

Academic Publishing is Evolving…

“Hail double knob, children of Mars”

This American Life, 9/28/2012

Galileo Kepler

I. Glass

Academic Publishing is Evolving…

• An enabling technology (the printing press)• A realization that the new technology is not just more efficient,

but is transformative in certain ways• A new conceptual leap (openness benefits all)

Oldenberg

Academic Publishing is Evolving…

349 years pass by…

http://www.s10forum.com/forum/f125/dragging-pics-284562/#post3879643

Academic Publishing is Evolving…

slowly

http://www.s10forum.com/forum/f125/dragging-pics-284562/#post3879643

Academic Publishing is Evolving…

http://home.web.cern.ch/images/2013/12/tim-berners-lee-cern

Academic Publishing is Evolving…

How Have We Arrived atOpen Access?

• The ‘serials crisis’ • The inability of individuals to access the

literature• The fact that taxpayers paid for it

Academic Publishing is Evolving…

How Have We Arrived atOpen Access?

• An enabling technology (the internet)• A realization that the new technology is not

just more efficient, but is transformative in certain ways

• A new conceptual leap (openness benefits all)

^ Really

Academic Publishing is Evolving…

Open Access

• The Bethesda Definition of Open Access (2003)

– Free, immediate access – Deposition in a digital public archive – Unrestricted reuse

Annual Article Output of all OA

Source: “Anatomy of open access publishing: a study of longitudinal development and internal structure”, Laakso & Björkhttp://www.biomedcentral.com/1741-7015/10/124 (BMC Medicine, Oct 2012)

Predicted ‘Disruption Timeframe’ of OA vs Subscription model

Source: “The Inevitability of Open Access”, David Lewishttp://crl.acrl.org/content/73/5/493.full.pdf+html (College and Research Libraries, Sep 2012

Academic Publishing is Evolving…

What is the Future?

Academic Publishing is Evolving…

Evolution?Or Revolution?

Academic Publishing is Evolving…

2004

2012

Academic Publishing is Evolving…

The deconstructing author:

• Drafts paper and shares with colleagues• Cleans up the paper / improves the language• Solicits critical feedback (pre- & post- publication)• ‘Publishes’ the article• Benefits from aggregation and discovery via Google• Can show impact & reach via various article level

metrics• Obtains credit for being a ‘good citizen’

Academic Publishing is Evolving…

The deconstructing author:

• Drafts paper and shares with colleagues• Cleans up the paper / improves the language• Solicits critical feedback (pre- & post- publication)• ‘Publishes’ the article• Benefits from aggregation and discovery via Google• Can show impact & reach via various article level

metrics• Obtains credit for being a ‘good citizen’

Academic Publishing is Evolving…

The deconstructing author:

• Drafts paper and shares with colleagues• Cleans up the paper / improves the language• Solicits critical feedback (pre- & post- publication)• ‘Publishes’ the article• Benefits from aggregation and discovery via Google• Can show impact & reach via various article level

metrics• Obtains credit for being a ‘good citizen’

Academic Publishing is Evolving…

The deconstructing author:

• Drafts paper and shares with colleagues• Cleans up the paper / improves the language• Solicits critical feedback (pre- & post- publication)• ‘Publishes’ the article• Benefits from aggregation and discovery via Google• Can show impact & reach via various article level

metrics• Obtains credit for being a ‘good citizen’

Academic Publishing is Evolving…

Also: annotatr, Arxiliv, Axios Review, Epistimio, Episciences, F1000 Prime, Haldane’s Sieve, OpenPub, Openreview.net, PaperCritic, PaperRater.org, Peer Evaluation, Peerage of Science, PubPeer, PubUp, Rubriq, Sympoze, SciOR, The Third Reviewer, TiNYARM, Publons, Journal Lab…

Academic Publishing is Evolving…

The deconstructing author:

• Drafts paper and shares with colleagues• Cleans up the paper / improves the language• Solicits critical feedback (pre- & post- publication)• ‘Publishes’ the article• Benefits from aggregation and discovery via Google• Can show impact & reach via various article level

metrics• Obtains credit for being a ‘good citizen’

Academic Publishing is Evolving…

PLOS ALMs

Academic Publishing is Evolving…http://www.altmetric.com/details.php?doi=10.7717/peerj.182

Altmetric Donuts

Academic Publishing is Evolving…

PeerJ Article Level Metrics

Academic Publishing is Evolving…

The deconstructing author:

• Drafts paper and shares with colleagues• Cleans up the paper / improves the language• Solicits critical feedback (pre- & post- publication)• ‘Publishes’ the article• Benefits from aggregation and discovery via Google• Can show impact & reach via various article level

metrics• Obtains credit for being a ‘good citizen’

Academic Publishing is Evolving…

The deconstructing author:

• Drafts paper and shares with colleagues• Cleans up the paper / improves the language• Solicits critical feedback (pre- & post- publication)• ‘Publishes’ the article• Benefits from aggregation and discovery via Google• Can show impact & reach via various article level

metrics• Obtains credit for being a ‘good citizen’

How’s that working out?

Academic Publishing is Evolving…

What’s missing?

Academic Publishing is Evolving…

Brand? Reputation?

Academic Publishing is Evolving…

Trust? Evaluation?

Academic Publishing is Evolving…

We Need ‘Trust and Evaluation’

NOT ‘Brand and Reputation’

Academic Publishing is Evolving…

Attributes

1. Editorial criteria which judges articles only on scientific soundness;

2. A very broad subject scope;3. An open access model employing a payment

model in which each article pays its own costs

Aside…

PLOS ONE’s Big Leap

They separated the ‘decision to publish’from the evaluation of ‘quality’ / ‘impact’

Academic Publishing is Evolving…

“rejected from at least six journals (including Nature, Nature Genetics, Nature Methods, Science) and took a year to publish before going on to be my most cited research paper (150 last time I looked)” – Cameron Neylon

Academic Publishing is Evolving…http://grigoriefflab.janelia.org/rejections

Academic Publishing is Evolving…

Q2 13

Q4 12

Q2 12

Q4 11

Q2 11

Q4 10

Q2 10

Q4 09

Q2 09

Q4 08

Q2 08

Q4 07

Q2 07

Q4 06

0

1000

2000

3000

4000

5000

6000

7000

8000

Year Pubs Notes2007

1,200  

2008

2,800 Largest OA journal

2009

4,400 3rd largest journal in world

2010

6,750 Largest journal in world

2011

13,800 ~1.4% of PubMed output in that year

2012

23,500 ~2.4% of PubMed output in that year

2013

~31,000

>3% of the relevant literature?

PLOS ONE Quarterly Output

PLOS ONE

Academic Publishing is Evolving…

Attributes

1. Editorial criteria which judges articles only on scientific soundness;

2. Sometimes a very broad subject scope;3. An open access model employing a

payment model in which each article pays its own costs;

Journals Which Do Not Select forImpact / Advance etc

Academic Publishing is Evolving…

PLOS ONE- ~4% of the literature in 2014- And many others… PeerJ, Elementa, Cureus, BMJ Open,

SAGE Open, PeerJ, Springer Plus, Scientific Reports (from Nature), Q Science Connect, Elementa, Optics Express, G3 (from the Genetics Society of America), Biology Open (from the Company of Biologists) , IEEE Access, AIP Advances, The Cogent Series (T&F), The Scientific World Journal, Cureus, F1000 Research, FEBS Open Bio, Science Advances (from AAAS), Royal Society Open Science, unnamed UC Press journal, Science Open. The list goes on…

- BUT also the BMC-Series, the “Frontiers in...” Series, and the ISRN Series from Hindawi etc

Journals Which Do Not Select forImpact / Advance etc

Journals Practicing an ‘objective’ editorial model

Journals Practicing an ‘objective’ editorial model

Journals Practicing an ‘objective’ editorial model

Academic Publishing is Evolving…

An OA future containing‘Impact Neutral’ Journals

PLOSONE

SAGEOpen

PeerJ

ALL

OTHER

OA

JOURNALS

etc.etc.

Trust? Evaluation?

So what about the Trust issue?

Academic Publishing is Evolving…

Academic Publishing is Evolving…

Open Peer Review would havesolved this ‘Trust’ problem

Academic Publishing is Evolving…

What is Open Peer Review?

• Reviewers are named• Reviews can happen ‘in the open’• Publication can happen 1st, followed

by open peer-review• Peer-review history is made public

Academic Publishing is Evolving…

‘Optional Open Peer Review’ at PeerJ• Reviewers are invited (pre-

publication) by an expert Editor• Reviewers are encouraged to name

themselves to the authors• Authors are allowed to make their

peer-review history public

Academic Publishing is Evolving…

• ~40% of PeerJ Reviewers name themselves.• ~80% of PeerJ Authors reproduce their peer review

history

Academic Publishing is Evolving…http://blog.peerj.com/post/100580518238/whos-afraid-of-open-peer-review

Academic Publishing is Evolving…

• Atmospheric Chemistry and Physics - Reviewers comments published on pre-pub discussion site. Reviewer names optional.

• Biology Direct - Reviewer comments published, and reviewers named

• BMJ Open - All reviewers named, all reports public• eLife - Decision letter published with articles with author

approval. Reviewers anonymous, but editor named. • EMBO journal - Review process file published with articles.

Reviewers anonymous, editor named. • F1000Research - All reviewers named, all reports public. • Frontiers journals - Reviewers named, but reports not public• GigaScience - Pre-publication history published with articles,

and reviewers named. (encouraged, opt-out)• Medical journals in the BMC series - Pre-publication history

published with articles, and reviewers named (encouraged). • PeerJ - Peer review history published with articles with author

approval. Reviewers encouraged to sign report.

Journals Practicing Some Form of Open Peer-Review

And what about the filtering / evaluation issue?

Academic Publishing is Evolving…

PLOS ALMs

Academic Publishing is Evolving…http://www.altmetric.com/details.php?doi=10.7717/peerj.182

Altmetric Donuts

Academic Publishing is Evolving…

PeerJ Article Level Metrics

Academic Publishing is Evolving…

Human Curated Lists

Explicitly Subjective Evaluation

Are ‘open peer review’ + ‘article-level evaluation tools’ the missing pieces?

Academic Publishing is Evolving…

PeerJ - Interesting FeaturesPeerJ- an entirely new Open Access business model- a broad based journal in the biological and medical sciences, judging

submissions based only on technical and scientific validity- fully peer reviewed, with rapid review process

handled by a (very) large editorial board- ‘Optional Open Peer Review’- Article-Level Metrics- Custom Collections- Q&A / Feedback / Contribution Points / Reputation system

PeerJ PrePrints- a preprint server for the biological and medical sciences- versioning- closely integrated with the journal- Q&A / Feedback- Article-Level Metrics

Academic Publishing is Evolving…

Academic Publishing is Evolving…

Feedback / Q&A

Evaluation /ALMs

Formal (but ‘open’)Peer -Review

ContributionPoints / ProfilePages

Academic Publishing is Evolving…

Academic Publishing is Evolving…

Where are we today?

• There is a culture in academia that seems to demand ‘prestige’

• Outdated thinking and insufficient metrics try to wrap ‘trust’ and ‘evaluation’ into the same thing

• As a result, published science is being judged on the wrong criteria

• Academics are increasingly aware that there are better alternatives, but often hold back from using them

• We have only recently gained a critical mass of OA content and the right ‘change is needed’ mindset to allow new developments to be tried

Academic Publishing is Evolving…

The journal landscape of 2024

• >95% of all articles are published open access• Pre-publication review still happens• But some form of open review is now the norm, not the exception• ‘Impact neutral’ (i.e. ‘objective’) review is now applied to >50% of all articles • New evaluation tools have become commonplace and are acceptable to quote on resumes• New aggregation tools (e.g. virtual journals or overlay journals) are now commonplace• Is this Evolution or Revolution?

everything evolves…even publishing

Academic Publishing is Evolving…

Thank You

Pete BinfieldCo-Founder and

Publisher

@p_binfieldpete@peerj.com

@ThePeerJwww.peerj.com

top related