MEGAN CARLSON & BOGDAN HOANCAUNIVERSITY OF ALASKA ANCHORAGE
Plenary II – Core Themes, Objectives, Achievement
Indicators; Planning; Effectiveness
UAA 2010 Accreditation Core Themes
Teaching and LearningResearch, Scholarship, and Creative Activities
Student success
Public square
UAA community
UAA 2010 Accreditation Core Themes
February 19, 2010
2
Carlson/Hoanca, UAA -- Plenary II
Process of Identifying the UAA 2010 Accreditation Core Themes
Teaching and LearningResearch, Scholarship, and Creative Activities
Student success
Public square
UAA community
UAA 2010 Accreditation Core Themes
February 19, 2010
3
Carlson/Hoanca, UAA -- Plenary II
Representative group
Brainstorming
Convergence
UAA 2017 Strategic Priorities
Core Themes Are Aligned with the UAA 2017 Strategic Plan…
Teaching and LearningResearch, Scholarship, and Creative Activities
Student success
Public square
UAA community
UAA 2010 Accreditation Core Themes
February 19, 2010
4
Carlson/Hoanca, UAA -- Plenary II
Executive input
Alignment with UAA 2017
Intent to revisit
after 2010
UAA 2017 Strategic Priorities
Core Themes Are Aligned with the UAA 2017 Strategic Plan, Aligned with Mission
Teaching and LearningResearch, Scholarship, and Creative Activities
Student success
Public square
UAA community
UAA 2010 Accreditation Core Themes
February 19, 2010
5
Carlson/Hoanca, UAA -- Plenary II
Teaching
Research
Engagement ,... higher education
needs of the state, its communities
Rich, diverse, and inclusive
environment
UAA mission
February 19, 2010Carlson/Hoanca, UAA -- Plenary II
6
Objectives and indicators
February 19, 2010Carlson/Hoanca, UAA -- Plenary II
7
They need to be Assessable Meaningful
Managerial dilemmas Output versus process indicators Accuracy versus significance Numbers versus stories Stability versus time series Setting a low bar versus setting up for failure
Selection of objectives and indicators
February 19, 2010Carlson/Hoanca, UAA -- Plenary II
8
Representative core theme groups “Own” the evaluation Change the evaluation process but not the
outcome
Phased approach Revise and update outcomes, objectives and
indicators Identify existing and needed data sources Conduct mock evaluation of core themes Revisit and repeat
June2009
Indicators: Teaching and Learning
February 19, 2010Carlson/Hoanca, UAA -- Plenary II
9
High Quality Teaching and
Learning
Assessment leads to
continuous improvement
Program level assessment
Effective Learning
Students achieve learning
outcomes
% of students who satisfied
learning outcomes
Students engage in effective learning
Students achieve
program and GER learning
outcomes
Student performance (assessment
reports)
February 2009 February 2010
Lessons Learned About Objectives, Outcomes and Indicators
February 19, 2010Carlson/Hoanca, UAA -- Plenary II
10
It is easier to identify processes (what we do) than outcomes (what we achieve)
You know for sure something is measurable only after having measured it
You know for sure something is relevant only after you are able to use it
Core themes, objectives, outcomes and indicators will continue to change over time
The importance of a deep understanding and clarity on core themes
February 19, 2010Carlson/Hoanca, UAA -- Plenary II
11
Core themes force continuous focus on all facets of the mission
Core theme objectives inform strategic planning and make it operational
Core theme outcomes and indicators align with funding priorities and management processes
Core themes roughly align with major units, facilitating assessment at all levels
The understanding and clarity are somewhat tempered by the constant changes
Addressing analysis and synthesis
February 19, 2010Carlson/Hoanca, UAA -- Plenary II
12
It is hard – and we are not done with it yetMoving from a “mechanistic” evaluation to one
based on synthesis Core themes overlap and interact Core themes synthesize across units
Fostering interactions between core theme groups
Asking some of the hard and overarching questions
October 2010 visit will confirm whether we truly understand the relationship
The 2010 NWCCU Standards:Transformational Benefits for UAA
February 19, 2010Carlson/Hoanca, UAA -- Plenary II
13
Engage in self assessment and improvementImprove external visibility of achievementsOvercome resistance and inertiaFoster dialog and cooperationSharpen management processesReduce, recycle and reuse
Align several internal and external reporting processes
Common indicators and outcomes Focus on mission fulfillment