tell your impact story: beginners guide to quality & impact metrics
DESCRIPTION
Tell your impact story: Beginners guide to quality & impact metrics. CURTIN UNIVERSITY LIBRARY. July 2014. Curtin University is a trademark of Curtin University of Technology CRICOS Provider code 00301J. This Session. Understand the when, how and why: Research impact and quality - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/1.jpg)
CURTIN UNIVERSITY LIBRARY
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
July 2014
Tell your impact story: Beginners guide to quality & impact metrics
![Page 2: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/2.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
This Session
Understand the when, how and why:
Research impact and quality Four-sector assessment
Scholarly Industry Government Societal
![Page 3: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/3.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Introduction
Evaluation of research quality and impact: Quality vs Impact Prestige Funding Promotion
![Page 4: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/4.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Using journal metrics for quantitative analysis: Journal Citation Reports - Web of Science
(Thomson product) SJR (SCImago Journal Rank) - Scopus
(Elsevier product)
Scholarly / Journal metrics
![Page 5: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/5.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
JCR
JCR > Search for a specific journal > Journal title search > (Journal Rank in Categories) Journal Ranking
JCR
![Page 6: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/6.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
SJR
SCImago website > Journal rankings> Subject area Business, Management & Accounting/Accounting > Journal Ranking
SJR
![Page 7: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/7.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Using the H- index to determine citation counts of individual authors, groups of researchers etc:
• The h-index is determined by calculating where h number of articles have been cited h or more times
• Found in citation databases e.g. Scopus or Web of Science, Publish or Perish from Google Scholar
• Influencing factors/cautions
Scholarly / Author metrics
![Page 8: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/8.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
H-index - Web of ScienceH-index Web of Science
![Page 9: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/9.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Average numbers of citations per discipline
Essential Science Indicators > Baselines > (By Averages) View the average citation rates table
Scholarly / Article metrics
![Page 10: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/10.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Scholarly / Qualitative measures
Using qualitative measures to determine impact:• Who is citing you• Measures of esteem – Editor of a prestigious work of reference
– Fellowship of a learned academic society
– Recipient of an Australia Council grant
![Page 11: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/11.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Industry & Government
Demonstrating return on investment: Measures of impact beyond academic Locate evidence How research is being applied
![Page 12: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/12.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
![Page 13: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/13.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
![Page 14: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/14.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Industry & Government
Impact narrative: An effect on, change or benefit to Developing a framework Case study approach
![Page 15: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/15.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Industry & Government
Socio-economic Objectives (SEO):
http://www.abs.gov.au/Ausstats/[email protected]/Latestproducts/CF7ADB06FA2DFD69CA2574180004CB82?opendocument
![Page 16: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/16.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Industry & Government
Impact narrative: EIA case-study approach
Link between research and impact Validation of impact
Other examples
![Page 17: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/17.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Industry & Government
![Page 18: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/18.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Industry & Government
http://www.csiro.au/Portals/About-CSIRO/What-we-do/Impact-case-studies/BodyArmour.aspx
![Page 19: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/19.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Societal
Sources for detecting potential influence
Exploring the boundaries: How altmetrics can expand our vision of scholarly community and social impactMike TaylorInformation Standards Quarterly Summer 2013 Vol. 35 Iss. 2
![Page 20: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/20.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Societal
Measures of impact Article-level metrics & Altmetrics
Altmetrics in Evolution: Defining and redfiing the ontology of article-level metricsJennifer Lin & Martin FennerInformation Standards Quarterly Summer 2013 Vol. 35 Iss. 2
![Page 21: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/21.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Societal
Measures of impact Article-level metrics & Altmetrics
![Page 22: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/22.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Societal
Impact narrative: Altmetrics hinges on the very prevalence of its own
diversity. Its raison d’etre is to provide a more expansive view of a research artefact's impactLin and Fenner (2013)
Levels of engagement
![Page 23: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/23.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Societal
Levels of engagement:
Lin and Fenner (2013)
![Page 24: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/24.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Societal
Levels of engagement:
Lin and Fenner (2013)
![Page 25: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/25.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Controversies or problemsSCIENTISTS DON’T COUNT: WHY YOU SHOULD IGNORE ALTMETRICS AND OTHER BIBLIOMETRIC NIGHTMARES
D Colquhoun & A Plested http://www.dcscience.net/?p=6369
Impact vs popularity
Societal
![Page 26: Tell your impact story: Beginners guide to quality & impact metrics](https://reader035.vdocuments.us/reader035/viewer/2022062723/56813e58550346895da84eb7/html5/thumbnails/26.jpg)
Curtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301JCurtin University is a trademark of Curtin University of TechnologyCRICOS Provider code 00301J
Future of altmetricsClearly now is the time to capitalise on the interest and attention to finally bring assessment of research out of the systems belonging to the print era and into a more modern, multifaceted system that takes advantage of the flexibility and scale of the webSocial signals reflect academic impact: What it means when a scholar adds a paper to Mendeley
William Gunn Information Standards Quarterly Summer 2013 Vol. 35 Iss. 2
Societal