![Page 1: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/1.jpg)
New developments in electronic publishing and bibliometrics
Henk F. Moed
CWTS, Leiden University, Netherlands
Elsevier, Amsterdam, Netherlands
![Page 2: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/2.jpg)
Contents
1 Beyond journal impact factor and H-index
2 How useful are university rankings?
3 Why combine indicators and peer review?
4 Can indicators be manipulated?
5 Does Open Access lead to higher impact?
6 More downloads more citations?
![Page 3: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/3.jpg)
Contents
1 Beyond journal impact factor and H-index
2 How useful are university rankings?
3 Why combine indicators and peer review
4 Can indicators be manipulated?
5 Does Open Access lead to higher impact?
6 More downloads more citations?
![Page 4: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/4.jpg)
Journal impact measures are no good predictors of an individual paper’s
actual citation impact
Partly based on International Mathematical Union’s Report ‘Citation Statistics’ (2008)
![Page 5: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/5.jpg)
Length boys vs. adults
0
5
10
15
20
25
30
35
0 15 35 55 75 95 115 135 155 175 195 215Length (cm)
% P
erso
ns
Boys (Meanlength=95 cm)Players (Meanlength=185 cm)
![Page 6: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/6.jpg)
Citations to P-AMS vs. T-AMS
0
10
20
30
40
50
60
70
80
0 1 2 3 4 5 6 7 8Nr Cites
% P
aper
s
PAMS (JIF=0.43)
TAMS (JIF=0.85)
![Page 7: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/7.jpg)
Normal vs. skewed distributions
0
5
10
15
20
25
30
35
0 15 35 55 75 95 115 135 155 175 195 215Length (cm)
% P
erso
ns
Boys (Meanlength=95 cm)Players (Meanlength=185 cm)
0
10
20
30
40
50
60
70
80
0 1 2 3 4 5 6 7 8Nr Cites
% P
aper
s
PAMS (JIF=0.43)
TAMS (JIF=0.85)
![Page 8: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/8.jpg)
What is the probability that .......
a randomly selected boy is at least as tall as a randomly selected player?
Almost zero
62 %a randomly selected PAMS paper is cited at least as often as a randomly selected TAMS paper?
![Page 9: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/9.jpg)
Probabilities still substantial for high JIF journals
![Page 10: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/10.jpg)
‘Free’ citations
![Page 11: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/11.jpg)
Thomson/JCR Journal Impact Factor
Citations to all docs
# Citable docs
![Page 12: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/12.jpg)
Citable vs. non-citable docs
Citable documents “non-citable” documents
Articles Letters
Reviews Editorials
Discussion papers
![Page 13: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/13.jpg)
The problem of “free” citations - 1
Cites
Docs + + + + +
+ + + + +
![Page 14: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/14.jpg)
The problem of “free” citations - 2
Cites
Docs + +
+ + + + +
“Free” Citations
![Page 15: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/15.jpg)
All three publication lists have a Hirsch Index of 5
30 P110 P2 8 P3 6 P4 5 P5 1 P6 0 P7
30 P110 P2 8 P3 6 P4 5 P5 4 P6 4 P7 4 P8 4 P9
100 P1 70 P2 8 P3 6 P4 5 P5 1 P6 0 P7
H=? H=? H=?5 5 5
123456789
Author 2Author 1 Author 3
![Page 16: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/16.jpg)
Different bibliometric distributions
have the same H-Index
![Page 17: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/17.jpg)
Indicators are becoming more informative
Feature Example
Embody ways to put numbers in context
Field-normalized citation measures
Take into account “who” is citing
Citations weighted with impact of citing source
Take into account relationship citing-cited author
Impact outside the own niche; multi-disciplinarity; bridging paradigms
![Page 18: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/18.jpg)
Contents
1 Beyond journal impact factor and H-index
2 How useful are university rankings?
3 Why combine indicators and peer review
4 Can indicators be manipulated?
5 Does Open Access lead to higher impact?
6 More downloads more citations?
![Page 19: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/19.jpg)
University ranking positions are primarily marketing tools,
not research management tools
![Page 20: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/20.jpg)
Research assessment methodologies must take into account… [EC AUBR Expert Group]
1. Inclusive definition of research / output
2. Different types of research and its impacts
3. Differences among research fields
4. Type and mission of institution
5. Proper units of assessment
6. Policy context, purpose and user needs
7. The European dimension
8. Need to be valid, fair and practically feasible
![Page 21: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/21.jpg)
Types of outputs (SSH)
Impacts Publication/text Non-publication
Scientific-scholarly
Journal paper; book chapter; monograph
Research data file; video of experiment
Educational Teaching course book; syllabus
Skilled researchers
Economic Patent Product; process; device; design; image
Cultural Newspaper article; Interviews; events; Performances; exhibits
![Page 22: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/22.jpg)
Top-down institutional analysis
Select an institution’s papers using author addresses (incl. verification)
Categorize articles intoresearch fields
Calculate indicators
Compare with benchmarks
![Page 23: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/23.jpg)
Bottom-up institutional analysis (CWTS)
Compile a list of researchers
Compile a list of publications per
researcher (incl. verification)
Aggregate researchers into groups, departments, fields, etc.
Calculate indicators;
compare with benchmarks
![Page 24: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/24.jpg)
Secondary analyses of ‘ranking’ data are informative
![Page 25: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/25.jpg)
Contents
1 Beyond journal impact factor and H-index
2 How useful are university rankings?
3 Why combine indicators and peer review
4 Can indicators be manipulated?
5 Does Open Access lead to higher impact?
6 More downloads more citations?
![Page 26: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/26.jpg)
Case study: A national Research Council
• Proposals evaluated by committees covering a discipline
• Reports from external referees
• Committee members can be applicants
![Page 27: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/27.jpg)
Affinity applicants – Committee
0 Applicants are/were not member of any Committee
1 Co-applicant is/was member of a Committee, but not of the one evaluating
2 First applicant is/was member of a Committee, but not of the one evaluating
3 Co-applicant is member of the Committee(s) evaluating the proposal
4 First applicant is member of the Committee(s) evaluating the proposal
![Page 28: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/28.jpg)
For 15 % of applications an applicant is a member of the evaluating Committee (Affinity=3, 4)
0
10
20
30
40
50
60
70
% A
PP
LIC
AT
ION
S
AFFINITY APPLICANTS-COMMITTEE
Projects 63.2 10.2 11.5 5.9 9.1
0 1 2 3 4
![Page 29: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/29.jpg)
Probability to be granted increases with increasing affinity applicants-Committee
30
40
50
60
70
80
% G
RA
NT
ED
AP
PL
ICA
TO
NS
AFFINITY APPLICANTS-COMMITTEE
Projects 37.0 46.9 60.1 62.6 74.0
0 1 2 3 4
![Page 30: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/30.jpg)
Logistic regression analysis: Affinity Applicant-Committee has a significant effect
upon the probability to be granted
MAXIMUM-LIKELIHOOD ANALYSIS-OF-VARIANCE TABLE (N=2,499) Source DF Chi-Square Prob ------------------------------------------------------------- INTERCEPT 1 18.47 0.0000 Publ Impact applicant 3 26.97 0.0000 ** Rel transdisc impact applicant 1 0.29 0.5926 Affinity applicant-Committee 2 112.50 0.0000 ** Sum requested 1 45.47 0.0000 ** Institution applicant 4 25.94 0.0000 ** LIKELIHOOD RATIO 199 230.23 0.0638
![Page 31: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/31.jpg)
The future of research assessment exercises lies in the intelligent
combination of metrics and peer review
![Page 32: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/32.jpg)
Contents
1 Beyond journal impact factor and H-index
2 How useful are university rankings?
3 Why combine indicators and peer review
4 Can indicators be manipulated?
5 Does Open Access lead to higher impact?
6 More downloads more citations?
![Page 33: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/33.jpg)
Effects of editorial self-citations upon journal impact factors
[Reedijk & Moed, J. Doc., 2008]
• Editorial self-citations: A journal editor cites in his editorials papers published in his own journal
• Focus on ‘consequences’ rather than ‘motives’
![Page 34: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/34.jpg)
Case: ISI/JCR Impact Factor of a Gerontology Journal (published in the journal itself)
0.0
0.5
1.0
1.5
2.0
2.5
3.0
3.5
4.0
4.5
5.0
2000 2001 2002 2003 2004
IMPACT FACTOR YEAR
CIT
ES
PE
R 'C
ITA
BL
E' D
OC
![Page 35: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/35.jpg)
Decomposition of the IF of a Gerontology journal
0.0
0.5
1.0
1.5
2.0
2.5
3.0
3.5
4.0
4.5
5.0
2000 2001 2002 2003 2004
IMPACT FACTOR YEAR
CIT
ES
PE
R 'C
ITA
BL
E' D
OC
Editorial self citations
Free citations
![Page 36: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/36.jpg)
One can identify and correct for the following types of
strategic editorial behavior
• Publish ‘non-citable’ items• Publish more reviews• Publish ‘top’ papers in January• Publish ‘topical’ papers (with high short term
impact) • Cite your journal in your own editorials• Excessive journal self-citing
![Page 37: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/37.jpg)
Contents
1 Beyond journal impact factor and H-index
2 How useful are university rankings?
3 Why combine indicators and peer review
4 Can indicators be manipulated?
5 Does Open Access lead to higher impact?
6 More downloads more citations?
![Page 38: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/38.jpg)
Deposited in OA rep
(o)
Not depositedin OA rep.
(no)
Journal articles
Average Impact (CPPo)
Average Impact
(CPPno)
?><=
![Page 39: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/39.jpg)
Three effects [Kurtz et al., 2005]
Open Access ArXiv increases access
Early View Articles appear earlier in ArXiv than in Publisher’s Website
Self-Selection (Quality bias)
Better authors use ArXiv
Authors deposit their best papers in arXiv
![Page 40: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/40.jpg)
0
96 97 98 99 00 01 02 03 04 05
Publication Years
OA
Imp
ac
t a
dv
an
tag
e
Quality Bias: Better authors use ArXiv
EarlyView Effec
t
ArXiv papers appear earlier
ArXiv, Cond Mat Phys[Moed, JASIST 2007]
100
![Page 41: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/41.jpg)
Age distribution of citations to Arxiv and non-ArXiv papers
0.00
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.10
0 6 12 18 24 30 36 42 48 54 60 66 72 78 84
Months after Publication Date
Cit
es
pe
r P
ap
er
in ArXiv-CM
Not in ArXiv-CM
3 per. Mov. Avg. (inArXiv-CM)3 per. Mov. Avg. (Notin ArXiv-CM)
Move curve by 6 months to the right
![Page 42: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/42.jpg)
Early view effect: Citations to papers deposited in ArXiv-CM start about 6 months earlier
0.00
0.01
0.02
0.03
0.04
0.05
0.06
0.07
0.08
0.09
0.10
0 6 12 18 24 30 36 42 48 54 60 66 72 78 84
Months after Publication Date
Cit
es
pe
r P
ap
er
in ArXiv 6 monthstranslated
Not in ArXiv-CM
3 per. Mov. Avg. (inArXiv 6 monthstranslated)3 per. Mov. Avg. (Notin ArXiv-CM)
![Page 43: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/43.jpg)
More research questions
• Early view effect also visible in a non-OA environment?
• Citation impact measured in biased sample?
![Page 44: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/44.jpg)
Contents
1 Beyond journal impact factor and H-index
2 How useful are university rankings?
3 Why combine indicators and peer review
4 Can indicators be manipulated?
5 Does Open Access lead to higher impact?
6 More downloads more citations?
![Page 45: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/45.jpg)
Downloads vs. Citations
More downloads more citations
or
More citations more downloads?
![Page 46: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/46.jpg)
Relation between citations and internet hits for 153 papers in volume 318 of the BMJ (1999)
Figure 1 from: Perneger, TV. BMJ. 2004, 329 (7465): 546–547. Relation between online “hit counts” and subsequent citations: prospective study of research papers in the BMJ
![Page 47: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/47.jpg)
Analogy Model
Formal use (e.g., SCI) Informal use (e.g.,SD)
(Collections of) publishing authors
(Collections of) users
Citing a document Retrieving the full text of a document
Article User session
Author’s institutional affiliation
User’s account name
Number of times cited Number of times retrieved as full text
![Page 48: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/48.jpg)
Age distribution downloads vs. citations[Tetrahedron Lett, ScienceDirect; Moed, JASIST, 2005]
0
4
8
12
16
20
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29
AGE (MONTHS)
%
SD USESCITATIONSDownloads
Citations%
Age (months)
![Page 49: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/49.jpg)
Ageing downloads vs. citations: Two factor vs. single factor model
0.01
0.1
1
10
100
0 4 8 12 16 20 24 28 32 36 40 44 48 52 56 60 64 68 72 76 80 84 88
Age (months)
Us
es
DownloadsObserved
DownloadsComputed
DownloadsSingularPoints
CitationsObserved
CitationsComputed
%
Age (months)
Downloads
Citations
![Page 50: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/50.jpg)
Citations lead to downloads[Moed, J. Am Soc Inf Sci Techn, 2005]
1
10
100
1000
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
AGE PAPER A (MONTHS)
DO
WN
LO
AD
S
A
B (B cites A)
C (C cites A and B)
PaperA published
Paper B published;it cites A
Download of A increases
Paper C published;it cites A and B
![Page 51: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/51.jpg)
Rank correlations between downloads and citations
Variables Spearman
R
Downloads vs. citations 0.22
‘Later’ (>3 months) downloads vs. citations
0.33
‘Initial’ (<3 months) downloads vs. citations
0.11
![Page 52: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/52.jpg)
Conclusions
• Positive correlation between downloads and citations partly due to the effect of citations upon downloads
• ‘Initial’ downloads and citations hardly correlate, and relate to distinct phases in processing relevant scientific information
• ‘Later’ downloads and citations show statistically similar properties of ageing and frequency distribution
![Page 53: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/53.jpg)
Downloads and citations relate to distinct phases in
scientific information processing
.... but (many) more cases must be studied
![Page 54: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/54.jpg)
Thank you for your attention!
![Page 55: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/55.jpg)
References• Eysenbach, G. (2006). Citation Advantage of Open Access Articles. PLOS Biology, 4, 692–698.• Garfield, E. (1972). Citation Analysis as a tool in journal evaluation. Science, 178, 471–479.• Garfield, E. (1979). Citation Indexing. New York: Wiley.• Yassine Gargouri, Chawki Hajjem, Vincent Lariviere, Yves Gingras, Les Carr, Tim Brody, Stevan Harnad
(2010). Self-Selected or Mandated, Open Access Increases Citation Impact for Higher Quality Research arXiv:1001.0361v2 [cs.CY]
• Harnad, S., & Brody, T. (2004). Comparing the impact of open access (OA) vs. Non-OA articles in the same journals. D-Lib Magazine, 10, Nr 6.
• Kurtz, M.J., Eichhorn, G., Accomazzi, A., Grant, C., Demleitner, M., Henneken, E., & Murray, S.S. (2005). The effect of use and access on citations. Information Processing & Management, 41, 1395–1402.
• Moed, H.F. (2005). Citation Analysis in Research Evaluation. Dordrecht (Netherlands): Springer. ISBN 1-4020-3713-9, 346 pp.
• Moed, H.F., Glänzel, W., and Schmoch, U. (2004) (eds.). Handbook of Quantitative Science and Technology Research. The Use of Publication and Patent Statistics in Studies of S&T Systems. Dordrecht (the Netherlands): Kluwer Academic Publishers, 800 pp.
• Moed, H.F. (2005). Statistical relationships between downloads and citations at the level of individual documents within a single journal. Journal of the American Society for Information Science and Technology 56, 1088-1097.
• Moed, H.F. (2007). The effect of “Open Access” upon citation impact: An analysis of ArXiv’s Condensed Matter Section. Journal of the American Society for Information Science and Technology 58, 2047-2054.
• Moed, H.F. (2009). New developments in the user of citation analysis in research evaluation. Archivum Immunologiae et Therapiae Experimentalis (Warszawa) 17, 13-18.
• Reedijk, J., Moed, H.F. (2008). Is the impact of journal impact factors decreasing? Journal of Documentation 64, 183-192.
![Page 56: New developments in electronic publishing and bibliometrics Henk F. Moed CWTS, Leiden University, Netherlands Elsevier, Amsterdam, Netherlands](https://reader033.vdocuments.us/reader033/viewer/2022042822/56649ecf5503460f94bdca46/html5/thumbnails/56.jpg)
ISI/JCR Journal Impact Factor of journal J for year T
Citations in year T to items published in J in years T-1 and T-2
÷Number of “citable” items published in J in
years T-1 and T-2