what’s all the h about? a summary of performance metrics for academics and journals
DESCRIPTION
The attraction of metrics is irresistible. The emergence of the quantified self as an emergent phenomenon to improve performance, health, and daily functioning has dramatically reshaped cultural perceptions of sharing and the relative good. The science of publica- tions is not free from this movement with a proliferation of metrics associated with both individuals and their scientific products. A dominant index, h, is central to the discussion associated with singular point estimate metrics versus the ineffable quality of the science we produce. The tension between quantity and quality or the modern redux of metrics versus quality is an excellent starting point in examination of the role metrics can play in improving or impeding scientific discovery. This dichotomy is of course fallacious but useful as means to test ideas associated with assigning merit to peer-reviewed publications. A brief overview of metrics is pro- vided in this talk including h with a strong emphasis on the theory of merit for the current dissemination pipeline in science.TRANSCRIPT
![Page 1: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/1.jpg)
![Page 2: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/2.jpg)
![Page 3: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/3.jpg)
![Page 4: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/4.jpg)
context quantities merit elite
metrics timeline h analysis
significancecontrasts options application
![Page 5: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/5.jpg)
data are the currency of science quantities
![Page 6: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/6.jpg)
data are the currency of science
+
quantities
![Page 7: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/7.jpg)
the greater good = feedback, filtering, change in behaviors.
![Page 8: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/8.jpg)
quality versus quantity
![Page 9: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/9.jpg)
volume of scientific literature immense
![Page 10: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/10.jpg)
volume of scientific literature immense
constellation of ideas
![Page 11: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/11.jpg)
merit
performancetime
loss
filter
![Page 12: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/12.jpg)
rank
sort
group
legacy
quality
impact forms
+ -
![Page 13: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/13.jpg)
unfortunately, much of the filtering not based on reading but numbers & tendencies
merit
![Page 14: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/14.jpg)
![Page 15: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/15.jpg)
critical assumption
![Page 16: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/16.jpg)
0
5
10
15
20
25
30
-5 -4 -3 -2 -1 0 1 2 3 4 5
Cite
s/yr
/pap
er a
nd IF
Effect size
cites/yr/paper
IF
![Page 17: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/17.jpg)
reject accept0
0.1
0.2
0.3
0.4
0.5
0.6E
ffect
siz
e
Support hypotheses
![Page 18: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/18.jpg)
0
1
2
3
4 5 6 7
LOG
cita
tions
per
pub
licat
ion
LOG total funding
![Page 19: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/19.jpg)
Why is this merit concept important?
![Page 20: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/20.jpg)
Fig. a)
Number of Articles
Num
ber o
f HC
0
5
10
15
20
25
100 200 300 400
Fig. b)
Number of Citations
Num
ber o
f HC
0
5
10
15
20
25
30
0 5000 10000 15000 20000
Fig. c)
Proportion Citations to Most Cited Article
Num
ber o
f HC
0
10
20
30
40
50
60
70
0.0 0.1 0.2 0.3 0.4 0.5
Fig. d)
Number of Journals
Num
ber o
f HC
0
10
20
30
40
0 20 40 60 80
Box 1
elite
![Page 21: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/21.jpg)
Fig. a)
log(Articles in Nature or Science)
Num
ber o
f HC
0
20
40
60
80
0 1 2 3 4 5
Fig. b)
Proportion Articles in Nature and Science
Prop
ortio
n C
itatio
ns
0.0
0.2
0.4
0.6
0.8
●●●●
●
●
●
●
●
●
●
●●
●
●●
●
●
●●
●
●
●
●
●
●
●● ●●
●●
●●
●
● ●●●●●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●●●
●●
●●
●
●
● ●
●
●●
●
●
●
●
●
●
●
●
●
●
●●
●
●●
●
●
●
●●
●
●●● ●●
●
●
●
●
●●
●
●
●
●●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●● ●
●
●● ●
●
●
●
●●
●
●
●●
●
●
● ●
●
●
●
●●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●●
●
●●●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●●
●
●●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●●
●
●●
●
●
●●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●● ●●●●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●●
●
●
●
●
●●
●
●
●
●
●
●
●●
0.1 0.2 0.3 0.4 0.5 0.6
Fig. c)
Proportion Articles in Favorite Journal
Num
ber o
f HC
0
10
20
30
0.2 0.4 0.6 0.8
Fig. d)
Proportion Articles in Favorite Journal
Prop
ortio
n C
itatio
ns
0.2
0.4
0.6
0.8
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●●
●●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●●
●
●
●
●●●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8
Box 2
![Page 22: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/22.jpg)
Fig. a)
Proportion Single Authored Articles
Num
ber o
f HC
0
20
40
60
80
100
120
0.0 0.2 0.4 0.6
Fig. b)
Proportion Single Authored Articles
Prop
ortio
n C
itatio
ns
0.0
0.2
0.4
0.6
0.8
●
●
●●
●
●● ●
●
●
●
●
●
●
●●
●
●●
●
●
●●
●
●
●
●
●
●●
●
●
●●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●●
●●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●●
●
●
●
●
●
●
●
●●
●●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
● ●
●
●
●
●
●
●
●●
● ●
●
●
●●
●
●
●●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●●
●●●
●●
●
●
●
●
●
●
●
●
●
● ●
●
●●
●●
●●
●
●●
●
●●
●
●
●
●●
●
●
●●
●
●
●●
●
●
●
●●●
●
●
●
●
●●●●
●
●
●
●
●
● ●●
●●
●
●
●
●
●●
●●●
●
●
●
●
●
●
●
●
●
●
●
●
0.0 0.1 0.2 0.3 0.4 0.5 0.6
Fig. c)
Proportion First Authored Articles
Num
ber o
f HC
0
5
10
15
20
25
30
0.0 0.2 0.4 0.6 0.8
Fig. d)
Proportion First Authored Articles
Prop
ortio
n C
itatio
ns
0.0
0.2
0.4
0.6
0.8
1.0
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
● ●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
● ●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
●
0.0 0.2 0.4 0.6 0.8
Box 3
![Page 23: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/23.jpg)
the metric elite misses not only diversity of people but ideas
![Page 24: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/24.jpg)
# publications# citationsh-index g-index w-index a-index r-index e-index m-index hg-index q2-index i10-index
20052006
2011
1905
mcpp
timeline
1902
JIF
![Page 25: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/25.jpg)
Why isn’t impact factor or citations sufficient?
![Page 26: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/26.jpg)
h
![Page 27: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/27.jpg)
![Page 28: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/28.jpg)
h relies on citations to papers not journalsnot skewed by singletons
not influenced by large body of uncited papersminimizes politics of publication
useful for similar stage comparisonsapplied to any group
counts citations regardless of whydoes not account for variations in average numbers of pubs
ignores number & position of authorslimited by total number so juniors disadvantagedincreasing h at high levels difficult so compression
data looks backwards not forward
+-
analysis
![Page 29: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/29.jpg)
psychology
contrasts
![Page 30: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/30.jpg)
economics
![Page 31: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/31.jpg)
finance
![Page 32: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/32.jpg)
marketing
![Page 33: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/33.jpg)
quality quantity
h solution
![Page 34: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/34.jpg)
however at larger scales, N still important
![Page 35: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/35.jpg)
overvalued scientists do publish significantly more
Matthew effect
![Page 36: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/36.jpg)
m
options
![Page 37: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/37.jpg)
i10
![Page 38: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/38.jpg)
h derivations such as h-coreor g index
![Page 39: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/39.jpg)
![Page 40: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/40.jpg)
![Page 41: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/41.jpg)
the solution is composite.
![Page 42: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/42.jpg)
![Page 43: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/43.jpg)
![Page 44: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/44.jpg)
![Page 45: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/45.jpg)
![Page 46: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/46.jpg)
![Page 47: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/47.jpg)
![Page 48: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/48.jpg)
![Page 49: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/49.jpg)
still numbers, just a different box
![Page 50: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/50.jpg)
volume of scientific literature immense application
![Page 51: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/51.jpg)
volume of scientific literature immense
curation connections
application
![Page 52: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/52.jpg)
application
journals individuals
departmentscollections
![Page 53: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/53.jpg)
curation
crowdsource
crowdsource
reputation economynot based on citation capital
journals/collections
editorssubject editors
refereesreaders
writers
dissemination pyramid
![Page 54: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/54.jpg)
curation by connection - big data
not by merit or citations - by relationships
individuals ideas data place utility
![Page 55: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/55.jpg)
science
merit
ideas
metrics
metrics
![Page 56: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/56.jpg)
filters
publications
however, mini-manuscripts, figshare, slideshare, pre-print servers, and data publications are transforming the publication process in science and providing new opportunities for discovery.
![Page 57: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/57.jpg)
metrics that illuminate & provide insight will be critical
ultimately, publications in all forms are extensions of learning
![Page 58: What’s all the h about? A Summary of Performance Metrics for Academics and Journals](https://reader034.vdocuments.us/reader034/viewer/2022051610/548c9541b479590f0d8b6319/html5/thumbnails/58.jpg)
citations to datasets/figures in talk
Costas, R. and Borodons, M. 2007. The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level. - The Journal of Informetrics 1: 193-203.
Harzing, A. W. and van der Wal, R. 2008. Comparing the Google Scholar h-index with the ISI Journal Impact Factor. - Resarch in International Management Products & Services for Academics Report.: 1-25.
Lortie, C. J., Aarssen, L. W., Budden, A. E., Koricheva, J., Leimu, R. and Tregenza, T. 2007. Publication bias and merit in ecology. - Oikos 116: 1247-1253.
Lortie, C. J., Aarssen, L. W., Parker, J. N. and Allesina, S. 2012. Good news for the people who love bad news: an analysis of the funding of the top 1% most highly cited ecologists. - Oikos 121: 1005-1008.
Lortie, C. J., Aarssen, L. W., Budden, A. E. and Leimu, R. 2012. Do citations and impact factors relate to the real numbers in publications? A case study of citation rates, impact, and effects sizes in ecology and evolutionary biology. - Scientometrics DOI: 10.1007/s11192-012-0822-6.
Marnett, A. 2013. H-Index: What It Is and How to Find Yours. - Benchfly blog.
Priem, J., Piwowar, H. and Hemminger, B. M. 2012. Altemtrics in the wild: using scoial media to explore scholarly impact. - arXiv 1203.4745v1.
Wardle, D. A. 2010. Do ‘Faculty of 1000’ (F1000) ratings of ecological publications serve as reasonable predictors of their future impact? . - Ideas in Ecology and Evolution 3: 11-15.