section 1 background and...
TRANSCRIPT
1
Embedding impact; effecting
institutional change through the
development and rollout of an
Impact Capture System
Julie BayleyImpact Officer
Senior Researcher in Health Psychology
Email: [email protected] @Julie_covuni
Julia RyallProgrammes Director
Post Award
Email: [email protected]
•To share Coventry’s experience of embedding impactPurpose
•To offer insight into developing strategies for your own institutionAim
•Research directors, managers and officers, funders, stakeholdersAudience
•Brief, to support planning for your institutionExercises
Resources
•Blog - http://blogs.coventry.ac.uk/researchblog/category/impact/
•Session materials (slides, booklet)
•Link to paper and slides (“Strategies for the management and
adoption of impact capture processes”) from EuroCRIS 2014
•Link to “How-to guide for developing an Impact Capture
System”, LSE Impact of Social Sciences blog post
Overview
1. Background and HE context
2. Coventry approach (with ‘ERIC’)
3. Research support context
4. Next steps
5. Q&A
Section 1
Background and
context
Research Impact
• Research Councils UK (RCUK) definition:
– 'the demonstrable contribution that excellent
research makes to society and the economy'.
• Broad types:
– Academic
– Economic
– Societal
– Environmental
Impact Drivers
• REF 2014
– Impact added to assessment criteria (not in RAE 2008)
• Academic excellence 65%
• Impact 20%
– Retrospective tracking and capture
• Expected increased weighting for impact in REF 2020
• Increased funder requirements for impact (eg. Horizon
2020)
• ‘Return on Investment’
2
Related context
• Ongoing discussions on measurement, assessment and
definitions e.g.
– Acceptable metrics
– Appropriate metrics
– Altmetrics
– Proxy measures
• Related drives eg. Open Access, international strategy
• Increasing focus on how to embed change institutionally
• How do we develop a systematised approach?
Challenges
• Experience of REF 2014
• Impact understanding /
awareness
• Impact is not static or
universally accepted
• Scepticism and suspicion
• Standardisation across
disciplines
• Attribution and ownership
• Intangible impact
• Time lag / tracking
• Control of information
• Bridging academic /
business divide
• Combining narrative with
metrics
• Non-funded projects
Section 2
Coventry University
Approach
EXERCISE 1
Booklet page 6-7
Impact is a good thingImpact can be captured
by an academic self service system
3
Impact capture and assessment are separate
activities
Different impacts can be ranked / weighted
Ranking / weighting impact is motivating for
academics
Priority should be placed on REF 2020 impact rather
than impact in broader terms
Impact is a ‘virtuous activity’Academics are suspicious
about Centrally led initiatives
4
“Embedding Research Impact at
Coventry” (ERIC)
• JISC funded project (2012) to develop a pilot impact
capture system
• System to plan and capture impacts from project inception
• VC commission: redeveloped to cover whole university
• Development:
– Development of impact markers
– Review of literature and guidance
– Academic and stakeholder consultation
*http://www.publicengagement.ac.uk/about/impact-analysis
Prototype development process
1. Impact needs analysis
Business and
Community
Engagement
2. Create content
Research
3. Technical process review
/ system adaptation
Information
Management
4. Pilot test system
Research
Full rolloutPilot
Purchase database Full launch
Consultation and engagement
across faculties
Modify/ extend database
Embedding
External literature / guidance
‘ERIC’ system
• Built within existing CU Research Information
Management system (BIDS)
• Add details of (multiple) planned impacts, those
which occur unexpectedly or remove those which
do not transpire.
• 4 steps to add an impact…..
1. Plan impact 2. Plan evidence
5
3. Set email
reminders4. Add evidence / defer / update
Benefits of ERIC
• ‘Institutional memory’
• Flexible system supports impact planning from project
inception
• Build and monitor ongoing impact portfolios
• Reduced reporting burden for REF 2020
• Support funding bids / reports to funders
• CU marketing, case studies and reputation building
Consultation feedback
Barriers Facilitators
0
2
4
6
8
10
12
14
16
18
20
Time /
workload
System
familiarity
Impact
awareness
System
difficulties
Attribution
and tracking
0
2
4
6
8
10
12
14
16
18
20
Training Raise
awareness
System
edits
Link across
university
Utilise data Access Increase
relevance
Section 3
Research Support
Context
Supporting the Impact Agenda
• Coventry’s Story: Past, Present, Future
• Changes in the Project Life Cycle
• Tensions, concerns, worries, solutions….
6
Coventry University Commitment
• Part of new “Excellence with Impact” strategic plan
• Impact Capture System (ERIC)
• Central Impact Officer (Academic)
• Faculty / research centre based impact personnel
• Broad and growing support structure for impact support
• Increasing reputation and presence across higher education
• Impact is valued
Impact across the project lifespan
Research
project £
Academic
outputCitations Impact
From...Impact considered at the end of the project..
Academic
“project”
Academic
outputCitations and metrics
ImpactOther
dissemination
Impact monitoring / evidencing
Impact planning
To…Impact built in from the start of a project…
Academic’s
Impact
Funded Projects
Non-Funded
Events / Conferences
To..
ArticlesMedia
Presence
EsteemMarkers
BIDSEventsForce
Ethics
Moodle RepositoryM&C
??
Publicly
Funded
Projects
£
Articles
From…
DisseminationConference
BIDS
Repository
Impact
Academics Heterogeneous
Research Support
Homogeneous
Strategic leads
Themes
Impact ‘Cogs’
We don’t know
what the Strategic
Leaders will require next
New different
drivers? When?
? What is the
information for
7
Academics Heterogeneous
Research Support
Homogeneous
Strategic leads
Themes
Everything?
Cross Cutting
Subject Specific
Indexed / Meta Tags
Immediacy
Impact ‘Cogs’
MoreFUNDING
Benchmarking
Ownership
OrganisationalReputation
Own Reputation
Longevity
RE-USE
PerformanceMeasure?
Ranking
Standardisation
Individuals
Key Challenges
Diverse
Context
Impact ‘Cogs’
Ownership
OrganisationalReputation
Own Reputation
Longevity
Standardisation
Individuals
Key Challenges
DiverseEverything?
Cross Cutting
Subject Specific
Indexed
ImmediacyRE-USE
Benchmarking
PerformanceMeasure?
Context
Academics
Research
Support
Strategic leads
Exercise 2: Your cogs
Booklet page 13
Section 4
Next steps
.…as a Sector
• Build in impact from the start
• Translate “Impact”
• Engage Academics
– Behaviour change, embed, deal with suspicion…
• Engage Stakeholders
• Build networks (internal and external)
• Bridge academic / research support divide
….at Coventry
• Continue building and rolling out system
• Grow impact culture / infrastructure
• Embedding impact and behaviour change
• Training
• System changes
• Dissemination (papers, reports, blogs)
Exercise 3: .…at your Organisation
1.
2.
3.
Booklet page 15
8
Summary
• Top-down support for bottom-up development
• Consider what works in your context
• ‘Engage not enrage’ academics
• Across-university system interaction
• Continued dialogue and revision
• Centralised and committed approach, locally translated
• Partnership is key
Thank you
Questions?
Julie BayleyEmail: [email protected]
Twitter @Julie_covuni
Julia RyallEmail: [email protected]
Exercise
• Proportional Impact Engagement (PIE)
chart