measuring impact of epa’s computational toxicology research · measuring impact of epa’s...
TRANSCRIPT
Measuring Impact of EPA’s Computational Toxicology
Research
Presenter: Monica LinnenbrinkEPA Office of Research and Development
Strategic Stakeholder Engagement and Outreach
Vision for CompTox Impact Site
• EPA CompTox Research• Transformative• Game-changing• Wide-spread interest
• Purpose: Track metric trends to showcase impact of research and evaluate usefulness of metric
• Learn from approach and broadly apply at multiple organizational levels (e.g., Chemical Safety for Sustainability Research Program)
Computational Toxicology Research Products
•Scientific publications and presentations
•Research data
•Software applications, code, algorithms and models
•Trainings, students and visiting scientists
3
What metrics should we track?
• Classical metrics – publications (How many, where published, how many times cited)
• Alternative metrics– publication and data downloads, views, (http://altmetrics.org/manifesto/)
• Most important – usage of research
• Usage of research for decision-making
• Presence of research or reference to it in influential documents such as budget or statutory language.
4
Alternative Metric Sources
• Many Social and Altmetric platforms in recent years…
• …and publishers use these for tracking, assisting
5
In development:Online Apps Google Analytics
11
The Power of a Tweet
Data & Tools: ToxCast Data Download Web
0
50
100
150
200
1-Sep-2015 1-Oct-2015 1-Nov-2015 1-Dec-2015 1-Jan-2016 1-Feb-2016
ToxCast Data Download Webpage Traffic (Daily)
Pageviews Unique Pageviews
0
500
1,000
1,500
2,000
2,500
September '15 October '15 November '15 December '15 January '16 February '16
ToxCast Data Download Webpage Traffic (Monthly)
Pageviews Unique Pageviews
In development:Data Download Google Analytics
Data & Tools: ToxCast Data Download Web Demographics
Top Users by Country1. United States 1,7152. Germany 1703. United Kingdom 1484. Canada 1205. France 1196. China 1177. Japan 848. Italy 789. South Korea 6010.Switzerland 56
123
4
56 78 9
10
In development:Google Analytics Demographics
In development:Media Coverage
Next Steps
• Investigate how to:• Consider relevance of the measures and evaluate other data
to collect. • “Roll-up” scores to show institution wide scores. • Compare our scores to other similar research institutions.• Track when others use CompTox research for decision making.• Address challenges such as evaluating research usage in gray
literature and changing ORD’s culture (scientific & technological)
• Integrate into existing/in development EPA systems – e.g. EPA Science Inventory
15
Our center – A BIG Impact!We are out to measure it…
16