COLLEGE OF MEDICINE

KPIs Guide

DEVELOPMENT & QUALITY UNIT

2

Table of Contents

Table of Contents 2

Speech of Dean of the college of medicine 3

Speech of Vice-Dean for Development and quality 4

College Vision, Mission and Goals 5

Introduction 6

Table -1 Benchmark types 8

Diagram – 1 MECHANISM OF Performance indicators measurement 9

Diagram – 2 Distribution of KPIs in relation to the relevant Strategic objectives 10

Table – 2 Links between the contents of the college mission, strategic objectives, and

key performance indicators 11

Diagram – 3 Distribution of the KPIs in relation to the contents of the program mission

13

Table - 3 Consistency of program key performance indicators and Najran university key

performance indicators 14

Table - 4 Consistency between program KPIs & vision 2030 15

Table – 5 Consistency of program KPIs with, NCAAA KPIs, and Afaaq KPIs 17

Table – 6 Program KPIs according to its type 19

Table – 7 KPIs description, Time of measurement and its responsible bodies 21

Important links 26

3

Speech of Dean of the college of medicine

The rapid evolving of the medical education institutions all around

the globe, resulting in shifting target of these institutions from the concept

of quantity to the concept of quality of their input in serving the local,

regional and international community; by providing competent doctors,

trustable distinguished scientific researches, and efficient community

services to support community health care and wellbeing.

In the college of medicine, We adopt quantitative and qualitative

measurable performance indicators in order to evaluate how far we achieve

our strategic objectives, in order to determine to which extent we fulfill our

mission, to Identify deficiencies, and to develop operational plans for

continuous improvement. Moreover, we choose benchmarks to compare our

performance with other national colleges, which help to assess the college

wellbeing and quality of the performance in relation to other national

colleges

Prof. DR. Mohamed Zayed Al Ayed

4

Speech of Vice-dean for Development and quality

The Vice deanship of the college of medicine for Development and

quality, through the unit of Development and quality, seeks to spread the

culture of development and quality to ensure that the standards of the

National Center for Academic Accreditation and Assessment (NCAAA) are

met; to ensure the quality of performance at the level of the medicine and

surgery program as an effort to contribute to achieving the vision, mission,

and strategic objectives of the college, and to achieve the leadership that the

college of medicine aspires to; in an integrated and reliable manner.

The Development and quality unit also focuses on the process of continuous

evaluation of all operations and activities within the college through which

it is possible to determine the level of its quality. This evaluation includes

all aspects of administrative, academic and research activities and other

activities that the college performs annually, enabling continuous

monitoring of the performance.

Evidence and information to support this evaluation are needed; among

these are performance indicators and the necessity for a benchmark

comparison with similar institutions and programs with good practices that

can be used, or information and measurements that can be compared with to

evaluate our performance.

In this booklet, the focus will be on explaining the types of performance

indicators and how to define and calculate them, as well as the types of

benchmark comparisons.

Dr.Abdullah Mufarreh Assiri

5

College Vision, Mission and Goals

College vision

Excellence in medical education and contribution to scientific research to promote health services and

participate in community service.

College Mission

Preparation of qualified medical personnel capable of providing distinguished medical services,

contributing to scientific research and establishing multiple partnerships to serve the community and

raise the level of health awareness.

College Goals

❖ Continuous Development of curricula and the means of medical education.

❖ Preparation of morally and professionally medical cadres, well qualified, and capable of

continuous self-learning.

❖ Development of the scientific research and cooperation with local, regional, and global

institutions in medical research environment.

❖ Development of the university hospital to provide excellent health services to the community

❖ Establishing an academic environment attract talented faculty members.

❖ To obtain accreditation from National Commission for Academic Accreditation & Assessment.

6

Introduction

Introduction

Definitions

Key Performance Indicators -KPIs:

It is the performance indicator that identifies evaluative criteria for scientific

assessment of an educational objective or student learning outcome

performance. A KPI must be measurable or written in a way that is designed

for assessment. When benchmarking and analysis are used with it, together,

they provide evidence for assessment to guide decision-making and

judgments.

Benchmark:

It is the performance level of achievement for a given KPI or performance

indicator. There are many kinds of benchmarks that align with KPIs;

therefore, it is necessary to qualify benchmarks in order to understand their

relationship to a given KPI. Benchmarks may be internal or external.

Target Benchmark:

It is the anticipated performance level or desired outcome (goal or aim) for a

KPI.

Finding Benchmark:

7

Also known as the actual benchmark; It is the actual outcome determined when the

KPI is measured or calculated. It represents the actual reality of the present

situation.

Internal Benchmarks:

They are benchmarks based on information from inside the program or institution.

Internal benchmarks include target or finding benchmark data results from

previous years.

External Benchmarks

They are benchmarks from similar programs or institutions that are outside the

program or institution. For example, external benchmarks for "student to teacher

ration" could be Six students to 1 teacher from a different program within the

institution or another program outside the institution, or for institutions, it refers to

other institutions (national or international).

KPI Analysis:

It is a process in which a comparison and contrast of the benchmarks to determine

strengths and recommendations for improvement. This is sometimes called

"benchmarking." For example, KPI analysis could compare and contrast "student

to teacher ratio" target and actual benchmarks from both internal and external

data banks to determine strengths and recommendations for improvement.

New Target Benchmark:

It is the establishment of a new or desired target.

8

The program of medicine and surgery utilizes quantitative or qualitative

measurable performance indicators in order to evaluate the extent to which

strategic objectives have been achieved, and that indicates how far the program

achieved its mission, to Identify deficiencies, and to develop operational plans for

continuous improvement.

The program measures the key performance indicators with benchmarking

depending on appropriate tools, such as (Surveys, Statistical data, etc.) according to

the nature and objective of each indicator, as well as determining the following

levels for each indicator:

• Actual performance

• Targeted performance level

• Internal reference (Internal benchmark)

• External reference (External benchmark)

• New target performance level

The college selects internal and external benchmarking, to assess the program

wellbeing and performance in relation to

Table -1 Benchmark types

Internal

benchmark

External benchmark

KPI of the same program for

the previous year

KPIs of the Program of

medicine, Qassim

University

KPIs of the Program of

medicine at King Khalid

University.

9

Diagram – 1 MECHANISM OF Performance indicators

measurement

Planning and follow-up

The responsible

committee of the index

OPERATION

Committee & Index

Performance

Measurement

INPUT

Committee & Index

Performance

Measurement

Committee

Formation a committee

to study the results of

the measurement to

identify strengths and

weaknesses.

1. Receive responses from

target groups.

2. Perform the necessary

statistical analyses

using the Statistical

Software Package

(SPSS).).

3. Discuss results, make

comparisons and

report.

Annual reports

for monitoring

approved

performance

indicators.

1. Follow-up on

the implementation

of improvement

plans.

OUTPUT

Committee & Index

Performance

Measurement

1. Paper & Electronic forms

2. The approved timeline

for submitting forms

electronically.

3. Links to the surveys on

the college's website.

4. Advertising procedures

and communication with

target groups to access

links

Planning and follow-up

College Agency for

Development and Quality

10

Diagram – 2 Distribution of KPIs in relation to the relevant

Strategic objectives

11

Table – 2 Links between the contents of the college mission,

strategic objectives, and key performance indicators

College Mission

Statement

Content of the

Mission

Consistent

Strategic

Objectives

Relevant Key Performance Indicators

Preparation of qualified

medical personnel

capable of providing

distinguished medical

services, contributing to

scientific research and

establishing multiple

partnerships to serve the

community and raise the

level of health awareness.

Teaching and

learning

1st Continuous

Development of

curricula and the

means of medical

education.

KPI-MED.2.Percentage of courses

students evaluated during the year

KPI-P.3.Students' Evaluation of the

quality of the courses

KPI-P.17. The satisfaction of

beneficiaries with the learning resource

KPI-MED.7. The satisfaction of

beneficiaries with facilities and

equipment.

2nd Preparation of

morally and

professionally

medical cadres,

well qualified and

capable of

continuous self-

learning.

KPI-P.2.Students' Evaluation of quality of

learning experience in the program

KPI-P.4.Completion rate

KPI-P.5.First-year students retention rate

KPI-P.6. Students' performance in the

professional and/or national examinations

KPI-P.7. Graduates' employability and

enrolment in postgraduate programs

within

KPI-P.8.The average number of students

in the class

KPI-P.9.Employers' Evaluation of the

program graduates' proficiency

KPI-P.10. Students' satisfaction with the

offered services

KPI-MED.3.Evaluation of students for

academic and professional guidance

KPI-P.11.The ratio of students to teaching

staff

5th Establishing an

academic

KPI-P.12.Percentage of teaching staff

distribution

KPI-P.13.The proportion of teaching staff

12

environment attract

talented faculty

members.

leaving the program

KPI-MED.6. Proportion (percentage) of

faculty members engaged in professional

development activities

6th To obtain

accreditation from

National

Commission for

Academic

Accreditation &

Assessment.

KPI-P.1. Percentage of achieved

indicators of the program operational

plan objectives.

KPI-MED.2. The degree of awareness of

the beneficiaries with the mission and

objectives (average range of knowledge

of faculty members and undergraduate

and graduate students in the thesis using a

five-year questionnaire)

Scientific

researches

3rd Development of

scientific research

and cooperation

with local, regional,

and global

institutions in the

medical research

environment.

KPI-P.14.Percentage of publications of

faculty members

KPI-P.15.Rate of published research per

faculty member

KPI-P.16.Citations rate in refereed

journals per faculty member

KPI-MED.4.The number of papers

(researches) or reports presented at

academic conferences for all faculty

members

Community

services

4th Development of

the university

hospital to provide

excellent health

services to the

community.

KPI-MED.5.Proportion (percentage) of

faculty members participating in

community service activities

KPI-MED.8.Satisfaction of beneficiaries

with the health services provided by the

university hospital

13

Diagram – 3 Distribution of the KPIs in relation to the contents

of the program mission

14

Table - 3 Consistency of program key performance indicators

and Najran university key performance indicators

No KPI code KPI program of medicine and

surgery

KPI

code

KPI of Najran university

1 KPI-MED.1 The degree of awareness of the beneficiaries

with the mission and objectives (average

range of knowledge of faculty members and

undergraduate and graduate students in the

thesis using a five-year questionnaire)

NU1.4 Satisfaction of the beneficiaries of

the university's mission and

objectives

2 KPI-P-02 Students' Evaluation of quality of learning

experience in the program

NU1.8 Final year student satisfaction rate

for academic program (calendar)

3 KPI-P-06 Students' performance in the professional

and/or national examinations

NU8.2 Ranking of graduates in

measurement tests at the level of

the Kingdom (health colleges -

teachers ..

4 KPI-P-09 Employers' Evaluation of the program

graduates' proficiency

NU8.1 Community and labour market

satisfaction ratio for graduate

performance skills

5 KPI-P-10 Students' satisfaction with the offered services NU6.6

Student satisfaction rate for

services and facilities provided by

the Deanship of Admissions and

Registration

6 KPI-MED.3 Evaluation of students for academic and

professional guidance

NU6.1

Student satisfaction rate for

counseling, social and

psychological services

7 KPI-P-12 Percentage of teaching staff distribution NU3.4 Percentage of Professor,

Associate Professor, Associate

Professor on both women's and

men's

8 KPI-MED.7 the satisfaction of beneficiaries with facilities

and equipment

NU4.1 Faculty satisfaction ratio for

facilities and equipment

9 KPI-MED.8 the satisfaction of beneficiaries with the health

services provided by the university hospital

NU6.4 Students’satisfaction rate for

health services

15

Table - 4 Consistency between program KPIs & vision 2030

KPI Code KPIs Vision 2030 objectives

KPI-P.02 Students' Evaluation of quality of learning experience in the program

Strategic objective

(1&4&5)

KPI-P.04 Completion rate

KPI-P.05 First-year students retention rate

KPI-P.08 The average number of students in the class

KPI-P.10 Students' satisfaction with the offered services

KPI-MED.03 Evaluation of students for academic and professional guidance

KPI-P.11 The ratio of students to teaching staff

KPI-P.01 Percentage of achieved indicators of the program operational plan objectives.

KPI-MED.01 The degree of awareness of the beneficiaries with the mission and objectives

KPI-MED.02 Percentage of courses students evaluated during the year Strategic objective (2) KPI-P.03 Students' Evaluation of the quality of the courses

KPI-P.17 The satisfaction of beneficiaries with the learning resource

KPI-MED.07 The satisfaction of beneficiaries with facilities and equipment.

KPI-P.14 Percentage of publications of faculty members Strategic objective

(2&3) KPI-P.15 Rate of published research per faculty member

KPI-P.16 Citations rate in refereed journals per faculty member

KPI-MED.04 The number of papers (researches) or reports presented at academic conferences

for all faculty members

16

KPI-P.06 Students' performance in the professional and/or national examinations Strategic objective

(4&5) KPI-P.07 Graduates' employability and enrolment in postgraduate programs within

KPI-P.9 Employers' Evaluation of the program graduate's proficiency

KPI-P.12 Percentage of teaching staff distribution Strategic objective (4) KPI-P.13 The proportion of teaching staff leaving the program

KPI-MED.06 Proportion (percentage) of faculty members engaged in professional

development activities

KPI-MED.05 Proportion (percentage) of faculty members participating in community service

activities Strategic objective

(1&5) KPI-MED.08 the satisfaction of beneficiaries with the health services provided by the

university hospital

17

Table – 5 Consistency of program KPIs with, NCAAA KPIs, and Afaaq KPIs

No KPI code KPI program of medicine and surgery NCAAA

KPIs

Afaaq

KPIs

1 KPI-P-01 Percentage of achieved indicators of the program operational

plan objectives.

KPI-P-01

2 KPI-P-02 Students' Evaluation of quality of learning experience in the

program

KPI-P-02 A8.2

3 KPI-P-03 Students' Evaluation of the quality of the courses KPI-P-03 A8.2

4 KPI-P-04 Completion rate KPI-P-04 A3.1

5 KPI-P-05 First-year students retention rate KPI-P-05

6 KPI-P-06 Students' performance in the professional and/or national

examinations

KPI-P-06

7 KPI-P-07 Graduates' employability and enrolment in postgraduate

programs within

KPI-P-07 A2.3

8 KPI-P-08 The average number of students in the class KPI-P-08

9 KPI-P-09 Employers' Evaluation of the program graduate's proficiency KPI-P-09 A7.1

10 KPI-P-10 Students' satisfaction with the offered services KPI-P-10 A7.2

11 KPI-P-11 The ratio of students to teaching staff KPI-P-11 A4.2

12 KPI-P-12 Percentage of teaching staff distribution KPI-P-12 A5.1

13 KPI-P-13 The proportion of teaching staff leaving the program KPI-P-13 A5.3

14 KPI-P-14 Percentage of publications of faculty members KPI-P-14 A10.1

18

15 KPI-P-15 Rate of published research per faculty member KPI-P-15 A12.2

16 KPI-P-16 Citations rate in refereed journals per faculty member KPI-P-16 A12.4

17 KPI-MED.6 Proportion (percentage) of faculty members engaged in

professional development activities

A8.1

18 KPI-P-17 The satisfaction of beneficiaries with the learning resource KPI-P-17

19

Table – 6 Program KPIs according to its type

NO KPI code KPI program of medicine and surgery Type

1 KPI-P-01 Percentage of achieved indicators of the program operational plan objectives. Productivity

2 KPI-MED.01 The degree of awareness of the beneficiaries with the mission and objectives Quality

3 KPI-P-02 Students' Evaluation of quality of learning experience in the program Quality

4 KPI-MED.02 Percentage of courses evaluated by the students during the year Quality

5 KPI-P-03 Students' Evaluation of the quality of the courses Quality

6 KPI-P-04 Completion rate Productivity

7 KPI-P-05 First-year students retention rate Efficiency

8 KPI-P-06 Students or graduates who were successful in the professional and / or national

examinations

Efficiency

9 KPI-P-07 Graduates' employability and enrolment in postgraduate programs Productivity

10 KPI-P-08 The average number of students in the class Efficiency

11 KPI-P-09 Employers' Evaluation of the program graduate's proficiency Efficiency

12 KPI-P-10 Students' satisfaction with the offered services Quality

13 KPI-MED.03 Evaluation of students for academic and professional guidance Quality

14 KPI-P-11 The ratio of students to teaching staff Efficiency

15 KPI-P-12 Percentage of teaching staff distribution Efficiency

16 KPI-P-13 The proportion of teaching staff leaving the program Efficiency

17 KPI-P-14 Percentage of publications of faculty members Productivity

20

18 KPI-P-15 Rate of published research per faculty member Productivity

19 KPI-P-16 Citations rate in refereed journals per faculty member Effectiveness

20 KPI-MED.04 The number of papers (researches) or reports presented at academic conferences for all

faculty members

Productivity

21 KPI-MED.05 Proportion (percentage) of faculty members participating in community service

activities

Effectiveness

22 KPI-MED.06 Proportion (percentage) of faculty members engaged in professional development

activities

Effectiveness

23 KPI-P-17 The satisfaction of beneficiaries with the learning resource Efficiency

24 KPI-MED.07 The satisfaction of beneficiaries with facilities and equipment Safety

25 KPI-MED.08 The satisfaction of beneficiaries with the health services provided by the university

hospital

Efficiency

21

Table – 7 KPIs description, Time of measurement and its responsible bodies

KPI code KPI operative KPI description Time of

measurement

Responsibility

KPI-P.01 Percentage of achieved

indicators of the

program operational plan

objectives.

Percentage of performance

indicators of the operational

plan objectives of the program

that achieved the targeted

annual level to the total number

of indicators targeted for these

objectives in the same year

Last four

weeks of the

academic

years

Mission and

Goals

Committee

KPI-

MED.01

The degree of awareness

of the beneficiaries with

the mission and

objectives

The mean of knowledge of

faculty members and

undergraduate and graduate

students with the program

mission and objectives. Using a

five-point scale in an annual

survey

Last four

weeks of the

academic

years

Mission and

Goals

Committee

22

KPI-P.02 Students' Evaluation of

quality of learning

experience in the

program

The mean of the rating of final year

students for the quality of learning

experience in the program on a

five-point scale in an annual survey

Last four

weeks of the

academic

years

Teaching and

Learning

Committee.

KPI-MED.02 Percentage of courses

evaluated by the

students during the

year

Percentage of courses taught and

then evaluated by the students in

the concerned year to the total

number of delivered courses in the

same year.

In the last

week of the

academic

year

Teaching and

Learning

Committee.

KPI-P.03 Students' Evaluation of

the quality of the

courses

The mean of students' rating for the

quality of courses on a five-point

scale in an annual survey

In the last

week of the

academic

year

Teaching and

Learning

Committee.

KPI-P.04 Completion rate The proportion of undergraduate

students who completed the

program in minimum Time in each

cohort

Beginning of

the second

semester of

the academic

year

Teaching and

Learning

Committee.

KPI-P.05 First-year students'

retention rate

Percentage of first-year

undergraduate students who

continue at the program the next

year to the total number of first-

year students in the same year

In the 1st four

weeks of the

next

academic

year-

Teaching and

Learning

Committee.

KPI-P.06 Students' performance

in the professional

and/or national

examinations

Percentage of students or graduates

who were successful in the

professional and / or national

examinations, or their score

average and median (if any)

According to

the result

disclosed by

SMLE

Teaching and

Learning

Committee.

KPI-P.07 Graduates'

employability and

enrolment in

Percentage of graduates from the

program who within a year of

graduation were:

Beginning of

the second

semester of

Teaching and

Learning

Committee.

23

postgraduate programs

a. employed

b. enrolled in postgraduate

programs

during the first year of their

graduation to the total number of

graduates in the same year

the academic

year

KPI-P.08 The average number of

students in the class

The average number of students per

class (in each teaching

session/activity: lecture, small

group, tutorial, laboratory, or

clinical session)

First 4 weeks

of the

academic

year

Teaching and

Learning

Committee.

KPI-P.09 Employers' Evaluation

of the program

graduate's proficiency

The mean of the rating of

employers for the proficiency of the

program graduates on a five-point

scale in an annual survey

One year

after their

graduate

Teaching and

Learning

Committee.

KPI-P.10 Students' satisfaction

with the offered

services

The mean of students' satisfaction

with the various services offered by

the program (restaurants, sports

transportation, facilities, academic

advising, ...) on a five-point scale in

an annual survey

Last four

weeks of the

academic

year

Students'

Committee.

KPI-MED.03 Evaluation of students

for academic and

professional guidance

The mean of students' satisfaction

with the appropriate academic and

vocational guidance for the all

teaching period on a five-point

scale in an annual survey for final

year students

Last four

weeks of the

academic

year

Students'

Committee.

KPI-P.11 The ratio of students to

teaching staff

The ratio of the total number of

students to the total number of full-

time and full-time equivalent

teaching staff in the program

First four

weeks of the

academic

year

Teaching

Staff

Committee

KPI-P.12 Percentage of teaching Percentage of teaching staff First four Teaching

24

staff distribution distribution based on:

a. Gender

b. Branches

c. Academic Ranking

weeks of the

academic

year

Staff

Committee

KPI-P.13 The proportion of

teaching staff leaving

the program

The proportion of teaching staff

leaving the program annually for

reasons other than age retirement to

the total number of teaching staff.

In the 1st

four weeks of

the next

academic

year

Teaching

Staff

Committee

KPI-P.14 Percentage of

publications of faculty

members

Percentage of full-time faculty

members who published at least

one research during the year to total

faculty members in the program

Last four

weeks of the

academic

year

Teaching

Staff

Committee

KPI-P.15 Rate of published

research per faculty

member

The average number of refereed

and/or published research per each

faculty member during the year

(total number of refereed and/or

published research to the total

number of full-time or equivalent

faculty members during the year)

Last four

weeks of the

academic

year

Teaching

Staff

Committee

KPI-P.16

Citations rate in

refereed journals per

faculty member

The average number of citations in

refereed journals from published

research per faculty member in the

program (total number of citations

in refereed journals from published

research for full-time or equivalent

faculty members to

the total research published)

Last four

weeks of the

academic

year

Teaching

Staff

Committee

KPI-MED.04 Number of researches

or reports submitted in

academic conferences

during the previous

The average number of researches

or reports submitted in academic

conferences during the previous

year per faculty member in the

Last four

weeks of the

academic

year

Teaching

Staff

Committee

25

year for all full-time

faculty members

program

KPI-MED.05 Percentage of staff

members and full-time

co-workers involved in

community service

activities

Percentage of staff members and

full-time co-workers involved in

community service activities to

total faculty members in the

program

Last four

weeks of the

academic

year

Teaching

Staff

Committee

KPI-MED.06 Percentage of faculty

members involved in

professional

development activities

during the previous

year

Percentage of staff members

involved in professional

development activities during the

previous year to total faculty

members in the program

Last four

weeks of the

academic

year

Teaching

Staff

Committee

KPI-P-17 The satisfaction of

beneficiaries with the

learning resource

(Students, staff

members)

The mean of beneficiaries'

(students') satisfaction with the

adequacy and diversity of learning

resources (references, journals,

databasesetc.) on a five-point scale

in an annual survey.

Last four

weeks of the

academic

year

Learning

Resources,

Facilities, and

Equipment

Committee

KPI-MED.07 The satisfaction of

beneficiaries with the

facilities and

equipment. (Students,

Staff member)

The mean of beneficiaries' (Staff

members') satisfaction with the

adequacy and diversity of learning

resources. (references, journals,

databases… etc.) on a five-point

scale in an annual survey.

Last four

weeks of the

academic

year

Learning

Resources,

Facilities, and

Equipment

Committee

KPI-MED.08 The satisfaction of the

beneficiaries with the

services provided in

the university hospital.

The mean of beneficiaries'

satisfaction with the services

provided in the university hospital.

(OPD, Lab, Pharmacy…etc.) on a

five-point scale in an annual

survey.

Last four

weeks of the

academic

year

Learning

Resources,

Facilities, and

Equipment

Committee

26

Important links

1. NCAAA KPIs for program accreditation:

https://etec.gov.sa/en/productsandservices/NCAAA/AccreditationProgrammatic/Pages/Forms.aspx

2. Afaaq higher education strategy:

https://sp.psau.edu.sa/sites/default/files/forms/field/file/st6.pdf

3. SAUDI ARABIA Vision 2030:

https://vision2030.gov.sa/en

27

Prepared by:

DR. OSMAN TAJELSIR DR. SOHEIR SOLIMAN DR. ABD ELRAHEEM ALMHBOUB

Supervisor of Supervisor of Chairman of

Development and quality unit Development and quality unit The Performance Measurement

Boys' section Girls' section Committee