Download - Benchmarking Nov 3
-
7/29/2019 Benchmarking Nov 3
1/13
Sarah L. Collie, Ph. D.
Office of the Vice President for Management and Budget
University of Virginia
-
7/29/2019 Benchmarking Nov 3
2/13
Are these examples of benchmarking?` A colleague at University of Wisconsin Madison has inquired
about our VP Research structure, which includes research andgraduate studies. UWM is looking at new models and would like
to talk to someone at U.Va. in VPR to learn more. UWM hasalready talked with Penn State.
` A survey of all University departments asking about each unitsrecord retention and destruction practices.
` U.Va.s Board of Visitors reviews the Universitys performanceon a set of predefined measures on an annual basis and comparesagainst the performance of 4 public institutions and 4 private
institutions.
2
-
7/29/2019 Benchmarking Nov 3
3/13
Benchmarking has different meanings.Comparative/Scorecard: How do we measure up?
A standard or reference by which others can be measured orjudged
Websters Dictionary
Process/Best Practices: Benchmarking forImprovement
Benchmarking means finding out who is the best in an area,studying how they work, and adopting the best practices thatare suitable to your own organization.
Dew, J. & Nearing, M (2004), Continuous Quality Improvement in Higher Education
Two approaches can/should complement one
another.3
-
7/29/2019 Benchmarking Nov 3
4/13
Scorecard Example
4
3
5
7
9
11
13
15
17
19
21
23
25
27
29
31
1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009
Berkeley
Michigan
Virginia
UCLA
UNC
Vanderbilt
Cornell
Penn
US NewsOverall Undergraduate Rank
Duke
Peer Mean
-
7/29/2019 Benchmarking Nov 3
5/13
Turning Surveys Into Reforms, Inside Higher Ed Article, 10/26/09
[The largest challenge facing NSSE is finding ways to be sure that campuses
actually use the results not just administer the survey.] S. Ikenberry, formerpresident of ACE
50
10
20
30
40
50
60
70
80
90
100
2000 2002 2005 2008
National Survey of Student Engagement Benchmarks
UVA 4th-Year
AAUDE 4th-Year
Student-Faculty Interaction
UVA 1st-Year
AAUDE 1st-Year
-
7/29/2019 Benchmarking Nov 3
6/13
Basic Benchmarking Methodology
6
ACT
Action Plan Implementation and Measure
ANALYZE
Data Collection Gap Analysis
PLAN
Decide What to Benchmark;Examine Own Processes
Identify Who to Benchmark
-
7/29/2019 Benchmarking Nov 3
7/13
PLAN
1. What to benchmark
y Identify critical processesy Collect internal data for comparison how measure
performance; Understand strengths and weaknesses ofcurrent process
2. Who to benchmarky Internal Units - comparison within an institutiony Other Colleges and Universities comparison
across institutionsy Functional Comparisons - across diverse settings -
higher education, corporate, industry, etc.y Best in Classcompare with exceptional performers
7
-
7/29/2019 Benchmarking Nov 3
8/13
ANALYZE
3. Collect data Collect comparative data qualitative/quantitative Calls, surveys, site visits, interviews, review of websites Systematic collection
4. Analyze data Gap between performance - Are others better? Why are they
better ?
New strategies/practices for adoption -What practices could weadapt and adopt?
ACT
5. Implement improvements Action plan for change Implement changes Measure results for effectiveness
8
-
7/29/2019 Benchmarking Nov 3
9/13
ExamplesBenchmarking at U.Va.
y Records Management
y Interactions with Prospective Undergraduates
y Embedded in unit operations
Other Unique Institutional Approaches
y Missouri State University - Identified a set of 11 Benchmark Institutions.Purposes: 1) to provide a group that can be used as benchmarks whencomparing public performance measures; 2) to identify and analyze "best
practices" that would make Missouri State more effective and/or efficient; and3) to analyze salary levels as one component toward identifying salary goals forMissouri State University.http://www.missouristate.edu/President/benchmark.htm
y Carleton University, http://www.carleton.ca/qualityinitiatives/index.html
The Office of Quality Initiatives reports into the Office of InstitutionalResearch and Planning. Establishes Benchmarking Teams to identify andunderstand the best practices in work processes, in order to improve our ability
to deliver services at Carleton University.
9
http://www.missouristate.edu/President/benchmark.htmhttp://www.carleton.ca/qualityinitiatives/index.htmlhttp://www.carleton.ca/qualityinitiatives/index.htmlhttp://www.missouristate.edu/President/benchmark.htm -
7/29/2019 Benchmarking Nov 3
10/13
Benchmarking Considerations
10
BenchmarkingEffort
Formality
Scope
(Numberand
Process)
Time
Resources
Type ofdata
-
7/29/2019 Benchmarking Nov 3
11/13
Resources(in addition to content specific professional associations)
y NCCI National Consortium for Continuous Improvement in HigherEducation
www.ncci-cu.org/
Catalyst for h.ed. institutions to work collaboratively across institutions toemploy effective methods for advancing academic and administrativeexcellence
y Higher Education Consortia www.highereducationconsortia.com/
To deliver information that supports and helps to facilitate cooperativeendeavors in h.ed.
y NACUBO National Association of College and University BusinessOfficers, http://www.nacubo.org/ (Examples: Student FinancialServices, Endowment)
11
http://www.ncci-cu.org/http://www.highereducationconsortia.com/http://www.nacubo.org/http://www.nacubo.org/http://www.highereducationconsortia.com/http://www.ncci-cu.org/ -
7/29/2019 Benchmarking Nov 3
12/13
y Academic Quality Improvement Program,
http://www.aqip.org/Innovation Exchange searchable database of innovative practices
y The Advisory Board, http://www.advisoryboardcompany.com/
The Advisory Board is a best practice research firm serving a
membership of more than 2,500 of the nation's leading hospitalsand academic medical centers, colleges and universities. Our
staff of 950 conducts extensive research and produces 55 major
best practice studies and more than 10,000 customized researchreports for our members each year.
12
http://www.aqip.org/http://www.advisoryboardcompany.com/http://www.advisoryboardcompany.com/http://www.aqip.org/ -
7/29/2019 Benchmarking Nov 3
13/13
Benchmarking isy Intentionaly Deliberatey Plannedy Action-orientedy Results in change - adapt and adopt for improvementy Ongoing and continuous
Benchmarking Tipsy Commit adequate time and resources to plan and execute
y Involve the right people
y
Select good benchmarking partnersy Dont limit to organizations that you consider to be superior or those that appear to
be most similar.
y Collect relevant data
y
Keep an open mind
13
Concluding Thoughts