what is a journal article and does it really matter?

31
What is a Journal Article and Does it Really Matter? Jeppe Nicolaisen Associate Professor Royal School of Library and Information Science Copenhagen, Denmark

Upload: ehren

Post on 15-Jan-2016

44 views

Category:

Documents


0 download

DESCRIPTION

What is a Journal Article and Does it Really Matter?. Jeppe Nicolaisen Associate Professor Royal School of Library and Information Science Copenhagen, Denmark. Operationalisation and its consequenses. Bradford’s law. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

What is a Journal Article and Does it Really Matter?

Jeppe NicolaisenAssociate Professor

Royal School of Library and Information ScienceCopenhagen, Denmark

Page 2: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Operationalisation and its consequenses

Page 3: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Bradford’s law

Articles on a given subject are published unevenly by journals. A few journals publish a relatively high number of the articles whereas many journals publish only one or a few articles each.

Page 4: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Bradford’s law

Nisonger (1998, pp. 139-140) argues in his textbook Management of Serials in Libraries that the following points are some of the “most obvious potentials” of Bradford analyses:

•Selection/deselection

•Defining the core

•Collection evaluation

•Calculation of cost at various coverage

•Setting priorities among journals

Page 5: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Bradford’s law

Hjørland & Nicolaisen (2005) and Nicolaisen & Hjørland (2007) demonstrated empirically that the way one chooses to operationalize the concept of subject, when conducting Bradford analyses, will influence on the results of the very same.

Page 6: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Bradford’s law

Bradford’s law does not automatically function as a neutral method. On the contrary, the results of utilizing Bradford analysis as a method for identifying the core information sources of any subject, field or discipline will depend in part on the way “subject” is operationalized.

Page 7: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Bradford’s law

Selection of information sources based on Bradford-distributions tends to favor dominant theories and views while suppressing views other than the mainstream at a given time.

Page 8: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Bradford’s law

Articles on a given subject are published unevenly by journals.

Page 9: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Bradford’s law

Articles on a given subject are published unevenly by journals.

Page 10: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Bradford’s law

Source: http://garfield.library.upenn.edu/essays/v4p476y1979-80.pdf

Page 11: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Bradford’s law

Articles on a given subject are published unevenly by journals.

Page 12: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

LIDA 2014 paper

A Bradford analysis of different kinds of journal articles produced by departments at Uppsala University, Sweden.

Page 13: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Method

A Bradford analysis includes three steps (Diodato, 1994):

1.Identification of items representing the object of study.

2.Registering sources publishing items in rank order beginning with the source that produces the most.

3.Division of the rank ordered sources into groups or zones (usually three) that produce roughly the same number of items.

Page 14: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Method

A Bradford analysis includes three steps (Diodato, 1994):

1.Identification of journal articles representing the object of study.

2.Registering sources publishing items in rank order beginning with the source that produces the most.

3.Division of the rank ordered sources into groups or zones (usually three) that produce roughly the same number of items.

Page 15: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Method

A Bradford analysis includes three steps (Diodato, 1994):

1.Identification of journal articles representing the object of study.

2.Registering departments at Uppsala University publishing items in rank order beginning with the source that produces the most.

3.Division of the rank ordered sources into groups or zones (usually three) that produce roughly the same number of items.

Page 16: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Method

DiVA was used to identify journal articles produced by the departments. DiVA indexes three kinds of journal articles:

•Refereed

•Other academic

•Other (popular science, discussions, etc.)

Page 17: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Method

DiVA was used to identify journal articles produced by the departments. DiVA indexes three kinds of journal articles:

•Refereed

•Other academic

•Other (popular science, discussions, etc.)

Page 18: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Results

Refereed journal articles produced by departments at Uppsala University, Sweden.

Other (popular science, discussions, etc.) journal articles produced by departments at Uppsala University, Sweden.

Page 19: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Departments in rank order of productivity F.

Dept. of Scandinavian Languages

Dept. of Theology

Dept. of Literature

Dept. of Archaeology and Ancient History

329

485

610

730

Dept. of History of Science and Ideas

Dept. of Economics

Dept. of Cultural Anthropology and Ethnology

Dept. of Medical Sciences

Dept. of Earth Sciences

Dept. of History

Dept. of Linguistics and Philology

Dept. of Neuroscience

Dept. of Surgical Sciences

Dept. of Modern Languages

University Library

814

879

936

989

1.037

1.082

1.126

1.166

1.206

1.245

1.283

All 1.908

Results

Refereed journal articles produced by departments at Uppsala University, Sweden.

Other (popular science, discussions, etc.) journal articles produced by departments at Uppsala University, Sweden.

Departments in rank order of productivity F.

Dept. of Medical Sciences

Dept. of Surgical Sciences

Dept. of Neuroscience

Dept. of Public Health and Caring Sciences

Dept. of Oncology, Radiology and Clinical

Immunology

5.377

8.587

11.410

13.986

16.285

Dept. of Genetics and Pathology

Dept. of Engineering Sciences

Dept. of Earth Sciences

Dept. of Women's and Children's Health

Dept. of Pharmaceutical Biosciences

Dept. of Information Technology

Dept. of Medical Biochemistry and Microbiology

Dept. of Medical Cell Biology

18.569

20.696

22.757

24.636

25.920

27.132

28.334

29.432

All 42.829

Page 20: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

The tacit assumption

Knowledge

Information

Raw data

Page 21: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Method

DiVA was used to identify journal articles produced by the departments. DiVA indexes three kinds of journal articles:

•Refereed

•Other academic

•Other (popular science, discussions, etc.)

Page 22: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Bibliometrics?

Yes, please!

Page 23: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Self evident?

Page 24: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

You become what you eat!

Page 25: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Altmetrics?

----------- REVIEW -----------This is competently written, but more could have been done to tie the analysis explicitly to the stated theme of the conference. The finding that privileging one kind of publication over others may result in variable indicators of impact is not altogether unexpected. More discussion of the broader implications of the findings would be good, specifically with regard to the current debate on the use and utility of alternative metrics.

----------- REVIEW -----------This looks an interesting paper, with competently conducted research. However, it does not really address itself directly to the LIDA theme; it would be helpful if the authors could extend their discussion of the results to issues of altmetrics per se.

Page 26: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Operationalisation and its consequenses

Page 27: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Operationalisation and its consequenses

• Does it really represent what it is supposed to represent?

• Is it flawed?

• Could the phenomenon under study have been operationalized differently?

• Would that have made a difference?

Page 28: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

‘Likes’ and ‘Upvotes’

Quality

Page 29: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

‘Likes’ and ‘Upvotes’

The status of 101.281 comments made by users over a 5 month period with more than 10 million views and rated 308.515 times, was monitored.

In collaboration with the service, the researchers had rigged the setup in such a way that whenever a user left a comment it was automatically rendered with either a positive upvote, a negative downvote or no vote at all for control.

If a comment received just a single upvote, the likelihood of receiving another upvote for the first user to see it was 32% relative to the control group. Additionally chances were also higher that such comments would proliferate in, or lemming to, popularity as the upvote group on average had a 25% greater rating than the control group.

Muchnik, L., Aral, S. & Taylor, S.J. (2013). Social influence bias: A randomized experiment. Science, 341(August 9), 647-651.

Page 30: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

Altmetrics?

The focus on operationalization and its consequences is (or should be) shared by all metrices!

Page 31: What is a Journal Article and Does it Really Matter?

For at ændre ”Enhedens navn” og ”Sted og dato”:

Klik i menulinjen, vælg ”Indsæt” > ”Sidehoved / Sidefod”.Indføj ”Sted og dato” i feltet for dato og ”Enhedens navn” i Sidefod

References

•Diodato, V. (1994). Dictionary of Bibliometrics. Binghamton, NY: Haworth Press.

•Hjørland, B. & Nicolaisen, J. (2005). Bradford’s law of scattering: Ambiguities in the concept of “subject”. Proceedings of the 5th International Conference on Conceptions of Library and Information Sciences, 96-106.

•Muchnik, L., Aral, S. & Taylor, S.J. (2013). Social influence bias: A randomized experiment. Science, 341(August 9), 647-651.

•Nicolaisen, J. & Hjørland, B. (2007). Practical potentials of Bradford’s law: A critical examination of the received view. Journal of Documentation, 63(3), 359-377.

•Nisonger, T.E. (1998). Management of Serials in Libraries. Englewood, CO: Libraries Unlimited.