benchmarking nov 3

7/29/2019 Benchmarking Nov 3

1/13

Sarah L. Collie, Ph. D.

Office of the Vice President for Management and Budget

University of Virginia


2/13

Are these examples of benchmarking?` A colleague at University of Wisconsin Madison has inquired

about our VP Research structure, which includes research andgraduate studies. UWM is looking at new models and would like

to talk to someone at U.Va. in VPR to learn more. UWM hasalready talked with Penn State.

` A survey of all University departments asking about each unitsrecord retention and destruction practices.

` U.Va.s Board of Visitors reviews the Universitys performanceon a set of predefined measures on an annual basis and comparesagainst the performance of 4 public institutions and 4 private

institutions.

2


3/13

Benchmarking has different meanings.Comparative/Scorecard: How do we measure up?

A standard or reference by which others can be measured orjudged

Websters Dictionary

Process/Best Practices: Benchmarking forImprovement

Benchmarking means finding out who is the best in an area,studying how they work, and adopting the best practices thatare suitable to your own organization.

Dew, J. & Nearing, M (2004), Continuous Quality Improvement in Higher Education

Two approaches can/should complement one

another.3


4/13

Scorecard Example

4

3

5

7

9

11

13

15

17

19

21

23

25

27

29

31

1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009

Berkeley

Michigan

Virginia

UCLA

UNC

Vanderbilt

Cornell

Penn

US NewsOverall Undergraduate Rank

Duke

Peer Mean


5/13

Turning Surveys Into Reforms, Inside Higher Ed Article, 10/26/09

[The largest challenge facing NSSE is finding ways to be sure that campuses

actually use the results not just administer the survey.] S. Ikenberry, formerpresident of ACE

50

10

20

30

40

50

60

70

80

90

100

2000 2002 2005 2008

National Survey of Student Engagement Benchmarks

UVA 4th-Year

AAUDE 4th-Year

Student-Faculty Interaction

UVA 1st-Year

AAUDE 1st-Year


6/13

Basic Benchmarking Methodology

6

ACT

Action Plan Implementation and Measure

ANALYZE

Data Collection Gap Analysis

PLAN

Decide What to Benchmark;Examine Own Processes

Identify Who to Benchmark


7/13

PLAN

1. What to benchmark

y Identify critical processesy Collect internal data for comparison how measure

performance; Understand strengths and weaknesses ofcurrent process

2. Who to benchmarky Internal Units - comparison within an institutiony Other Colleges and Universities comparison

across institutionsy Functional Comparisons - across diverse settings -

higher education, corporate, industry, etc.y Best in Classcompare with exceptional performers

7


8/13

ANALYZE

3. Collect data Collect comparative data qualitative/quantitative Calls, surveys, site visits, interviews, review of websites Systematic collection

4. Analyze data Gap between performance - Are others better? Why are they

better ?

New strategies/practices for adoption -What practices could weadapt and adopt?

ACT

5. Implement improvements Action plan for change Implement changes Measure results for effectiveness

8


9/13

ExamplesBenchmarking at U.Va.

y Records Management

y Interactions with Prospective Undergraduates

y Embedded in unit operations

Other Unique Institutional Approaches

y Missouri State University - Identified a set of 11 Benchmark Institutions.Purposes: 1) to provide a group that can be used as benchmarks whencomparing public performance measures; 2) to identify and analyze "best

practices" that would make Missouri State more effective and/or efficient; and3) to analyze salary levels as one component toward identifying salary goals forMissouri State University.http://www.missouristate.edu/President/benchmark.htm

y Carleton University, http://www.carleton.ca/qualityinitiatives/index.html

The Office of Quality Initiatives reports into the Office of InstitutionalResearch and Planning. Establishes Benchmarking Teams to identify andunderstand the best practices in work processes, in order to improve our ability

to deliver services at Carleton University.

9
http://www.missouristate.edu/President/benchmark.htmhttp://www.carleton.ca/qualityinitiatives/index.htmlhttp://www.carleton.ca/qualityinitiatives/index.htmlhttp://www.missouristate.edu/President/benchmark.htm


10/13

Benchmarking Considerations

10

BenchmarkingEffort

Formality

Scope

(Numberand

Process)

Time

Resources

Type ofdata


11/13

Resources(in addition to content specific professional associations)

y NCCI National Consortium for Continuous Improvement in HigherEducation

www.ncci-cu.org/

Catalyst for h.ed. institutions to work collaboratively across institutions toemploy effective methods for advancing academic and administrativeexcellence

y Higher Education Consortia www.highereducationconsortia.com/

To deliver information that supports and helps to facilitate cooperativeendeavors in h.ed.

y NACUBO National Association of College and University BusinessOfficers, http://www.nacubo.org/ (Examples: Student FinancialServices, Endowment)

11
http://www.ncci-cu.org/http://www.highereducationconsortia.com/http://www.nacubo.org/http://www.nacubo.org/http://www.highereducationconsortia.com/http://www.ncci-cu.org/


12/13

y Academic Quality Improvement Program,

http://www.aqip.org/Innovation Exchange searchable database of innovative practices

y The Advisory Board, http://www.advisoryboardcompany.com/

The Advisory Board is a best practice research firm serving a

membership of more than 2,500 of the nation's leading hospitalsand academic medical centers, colleges and universities. Our

staff of 950 conducts extensive research and produces 55 major

best practice studies and more than 10,000 customized researchreports for our members each year.

12
http://www.aqip.org/http://www.advisoryboardcompany.com/http://www.advisoryboardcompany.com/http://www.aqip.org/


13/13

Benchmarking isy Intentionaly Deliberatey Plannedy Action-orientedy Results in change - adapt and adopt for improvementy Ongoing and continuous

Benchmarking Tipsy Commit adequate time and resources to plan and execute

y Involve the right people

y

Select good benchmarking partnersy Dont limit to organizations that you consider to be superior or those that appear to

be most similar.

y Collect relevant data

y

Keep an open mind

13

Concluding Thoughts

benchmarking nov 3

Documents