scival introductory session dr charles martinez customer ... · introducing field-weighted citation...
TRANSCRIPT
SciVal Introductory session
Dr Charles Martinez
Customer Consultant
Agenda
1. Scopus: The data source of SciVal
2. Metrics in SciVal – how to use responsibly
3. SciVal
Scopus
Scopus is the largest abstract and citation database of peer-reviewed
literature, and features smart tools that allow you to track, analyze and
visualize scholarly research.
Scopus delivers a comprehensive view on the world of research.
No packages, no add-ons. One all-inclusive subscription.
76 million+
Informing national research assessments, policies & reports
Provision of citation data services for national assessments as well as data, analyses and insights for national and international reports
BIS reports ‘11 ,’13 & BEIS ‘16
Gender report – now available at
institutional level
THE World University Rankings (from ‘15) and data partner for QS
Introduction to Metrics in SciVal
Bibliometrics 101
Bibliometrics are measures of output and indicators of impact.
Probably the simplest bibliometric is a count of publications. More advanced
bibliometrics help you to understand the impact of your academic publications
within the scope of the worldwide research community.
You can use bibliometrics to look at different types
of impact.Your impact at point of publication:
• What are the top journals in your field? Where should you aim to publish?
• Have you been successful in getting your paper into an above average journal for your research area?
Your impact post publication (otherwise known as citation impact):
• How many times has your paper been cited?
• Has your paper attracted more citations than normal?
• Who is citing your work? Which researchers from which institutions?
Your impact through knowledge transfer:
• From which subject areas are most of your citations coming?
• Are any research fields outside of your own unexpectedly interested in your work?
Your impact through collaboration:
• Who do you publish with most? And, who do they publish with most?
• How international is the scope of your collaboration?
• Are you overlooking any potential collaboration opportunities?
Research metrics guidebook
• Understanding
metrics
- Scopus as data source
• Selection of
appropriate metrics
- What affects their
values, besides
performance?
• For each metric
- Situations in which they are useful
- When to take care and
how to address short-
comings
- Worked examples
The importance of triangulation
Expert opinion
Peer review
Reliable data
Strategic
Planning
for
Research External Review
No single metric is perfect. Always
use at least two metrics to give
insight into your question
A broad range of metrics is essential
for you to be able to address your
many questions,
No data set is perfect. Always reinforce your
evidence-based conclusions with at least one of,
and ideally both, peer review and expert opinion
Journal metrics in SciVal
Modified SNIP
• Refined metric calculation, better corrects for
field differences
• Outlier scores are closer to average
• Readily understandable scoring scale with an
average of 1 for easy comparison
Modified SJR
• More prestigious nature of citations that
come from within the same, or a closely
related field
• Readily understandable scoring scale with
an average of 1 for easy comparison
Introducing Field-Weighted Citation Impact
(FWCI)• FWCI indicates how the number of citations received by an entity’s publications
compares with the average number of citations received by all other similar publications in the data universe
• A FWCI of 1.00 indicates that the entity’s publications have been cited exactly as would be expected based on the global average for similar publications
• Imperial College London has a FWCI of 2.18 for period 2013-2018 meaning that your publications are cited over twice as much as the world average
• The UK had a FWCI of 1.57 for the same period
• Best used with:
• Citation Count and Citations per Publication
• ‘Time-independent metrics’ e.g. Collaboration, Academic-Corporate Collaboration and Publications in Top Journal Percentiles
Limitations of FWCI
Not recommended for small publication sets (such as a researcher’s
output) - Entities are small so that the metric may fluctuate significantly and
appear unstable over time. Field-Weighted Citation Impact calculates an
average value, and these types of calculations are strongly influenced by
outlying publications in a small data set
FWCI is a time dependent metric, recently published material where the short
time that has passed since publication will reduce the reliability of basing
decisions on citation information.
Preamble
• Don’t assume that senior decision makers necessarily understand the
principles of responsible metrics we discussed earlier
• They may be obsessed with the size of their h-index or the Impact Factor
of the Journal they edit
• They may not unaware of subject differences
• They may want a quick answer that confirms their prejudices
• Your challenge, should you accept it, is to help prevent metricide!
Getting Started
SciVal overview
SciVal offers quick, easy access to the research performance of 220 nations and
>10000 research institutions worldwide.
Overview: institutional performance indicators
Overview: institutional performance indicators
Collaborations
Publications
Publication Strategy
Durrant Group
Durrant Group
Topics of Prominence
Network Graphs – Production, Collaboration, Impact, Visualization..
Topics of Prominence
Looking at a specific institution
to collaborate with..
• What are the most prominent
topics this institution is active in
?
• What is this institution’s
presence in topics of
prominence across the subject
fields ?
• Show me the dynamics within
this topic, the top performers
and rising stars ?
• Are there any other topics I
should keep an eye on ?
Recent advances in clustering and modelling
science allow us to partition science into Topics
• We have identified ~100.000 global research topics and ranked them byProminence.
• Prominence is a new indicator that shows the current momentum of a topic by looking at citations, views and CiteScore values.
• Prominence predicts funding – helps researchers and research managers identify topics in which funding will increase.
• Going way beyond what the competition can do…
Topics of Prominence—A Planning Solution
Topics of Prominence
Topics of Prominence
Topics of Prominence
Topics of Prominence
Topics of Prominence
Topics of Prominence
Patent citations
Patent citations
Patent citations
Patent Metrics on SciVal
Article 1
Patent 1
ACME Group
Patent 2
Wayne Enterprises
Article 2
Patent 3Stark
Industries
Citing-Patents Count = 3
Patent-Cited Scholarly Output = 2
Patent-Citations Count = 4
3 patents have cited your research - Citing-Patents Count
2 scholarly outputs have been cited by patents - Patent-Cited Scholarly Output
Your research has been cited in patents 4 times - Patent-Citations Count
(remember a patent could cite different publications at a time)
University Articles
NB patent
citations can be found at an article level on Scopus
How can I benchmark Imperial College against other
institutions?
How can I benchmark Imperial College London
against other institutions?
Who do you collaborate with in China?
Who do you collaborate with in China?
What is behind the collaboration?
Which corporates do you co-author with?
Exploring Topics further with Trends
Exploring Topics further with Trends
Exploring Topics further with Trends
Exploring Topics further with Trends
Thank you