science of science policy - isc intelligence in science · –active engagement with science of...
TRANSCRIPT
Science of Science Policy
Julia Lane
2
Overview
Current Context
SciSIP Program Status
– Research and Findings
Science of Science Policy Interagency Group Status
STAR METRICS
Next Steps
3
3
Current Context
• Investment in Science
– American Recovery and Reinvestment Act
– The National Academy of Sciences Speech, April 2009
• Openness and transparency
– data.gov; open.gov; etc.
• Evidence based policy
– Joint memo on “Science and Technology Priorities for the FY2011 Budget” :
Science of Science Policy (is the only program listed by name)
• Accountability
– ARRA Reporting Guidelines
– Putting Performance First: Replacing PART with a new performance improvement
and analysis framework
SciSIP Program Status
Background
– program established in 2005, $8-10 million/year
– Explicitly interdisciplinary – economists, sociologists,
psychologists, political scientists, anthropologists, computer
scientists, domain scientists
– Goals: Understanding (theories); measurement (models, metrics,
datasets); community of practice (academics, practitioners)
• Current status
– 75 awards made in three solicitations since 2007
– Active engagement with Science of Science Policy Interagency
group
4
Research Findings
To be found on website
http://scienceofsciencepolicy.net
Shared on listserv (almost 700 participants,
nationally and internationally)
AAAS workshop
SOSP workshop
5
Research Findings
6
Research Findings
7
8
SOSP Interagency Group
The SoSP Roadmap
– Published in November, 2008
– Four guiding themes; Ten key questions
December, 2008 Workshop
– Interactive evaluation of Roadmap
October 2009 Workshop
– Best practices and information sharing
Standing NSTC Committee
STAR METRICS
STAR METRICS (Science and Technology for America’s Reinvestment: Measuring the Effect of Research on Innovation, Competitiveness and Science), is the first national federal and university partnership to document the outcomes of science investments to the public.
Initially, we will develop a transparent way of calculating the initial impact of federal science spending on job creation.
Subsequently we will develop an infrastructure to measure the impact of federal science investment on economic growth (through patents, firm start ups and other measures),
workforce outcomes (through student mobility and employment),
scientific knowledge (such as publications and citations) and, later,
social outcomes (such as health and environment)
STAR METRICS: Principles
Narrow and biased metrics will yield narrow and
biased science
Good metrics should
be grounded in theoretical framework
include scientific, social, economic outcomes
be generalizable and replicable
be developed from the bottom up
Minimize burden
10
11
Building an Empirical Framework
Start with correct unit of analysis
– Science is done by scientists. Need to identify universe of
individuals funded by federal agencies (PI, co-PI, RAs,
graduate students etc.)
Include full description of input measures
Include full description of outcomes (economic,
scientific and social)
Combine inputs and outcomes
Create appropriate metrics that capture all
dimensions of science investments
12
This has been achieved in other countries
13
14
STAR METRICS Approach –
“Keeping it Simple”
Academic Grantee Institutions
Federal S&T Funding Agencies
16
Research Funding and Jobs
17
SCIENTIFIC IMPACTS
18
19
ECONOMIC IMPACT
BRIEF EXAMPLE:
20
21
1st LCC in S. Cal
Medtronic
Univ. of California
Belkin Int’l: computer connectivity hardware
Second Sight: retinal prosthesis (cybernetic eyeglasses)
Alfred Mann Foundation: funds medical device research
Node: inventor; link: co-authorship; color: organization
Zeroing in on PIs
Node: inventor; link: co-authorship; color: organization
1. Knowledge Diffusion
Three links out
(Singh 2005)
2. Sources of Links
Student graduationInventor mobilityDirect collaboration
(Fleming 2007)
Zeroing in on
PIs
Morteza Gharib(Hans W. Liepmann Prof of
Aeronautics and
Bioengineering)
Axel Scherer (Neches
Prof of Electrical
Engineering, Applied
Physics and Physics)
probably generating
significant spillovers in
local economy, probably
through student mobility
or direct collaboration
Node: inventor; link: co-authorship; color: organization
25
Science Agency and University Partnership
Current
– OSTP and major science agency led initiative
– Actual, administratively based, externally verifiable, measures of job creation for
pilot universities
Common empirical infrastructure available to all universities and
science agencies to quickly respond to State, Congressional and
OMB requests
University faculty are invited to participate in matching exercise with citations,
patents, patent applications and other economic/scientific/social outcome metrics
25
Potential for International Collaboration
Build collaborative data infrastructure (think Large
Hadron Collider for science)
– Describing flows of researchers
– Describing ways in which scientific ideas are transmitted
and adopted
– Describing broader impact
Common empirical infrastructure and conceptual
framework for science agencies to document impact
of science investments (Unique Researcher IDs)
SOSP Interagency Group for Europe
SciSIP Program for Europe
26
Contact Information
Stefano Bertuzzi ([email protected])
Diane DiEuliis ([email protected])
Julia Lane ([email protected])
27