Qiu Jun-pingResearch Center for Chinese Science Evaluation

E-mail: jpqiu@whu.edu.cn http://www.nseac.com Tel: 86-27-68754477

An Overview on the Methods and Results of Chinese Universities Evaluation

23/4/12 RCCSE 2

RCCSE

• Research Center for Chinese Science Evaluation of Wuhan University (RCCSE) is a comprehensive evaluation agency embracing education evaluation, science and technology evaluation, etc.

• Based on the broad investigation and deep analysis, four kinds of evaluation reports have been released since 2004.

23/4/12 RCCSE 3

• ①An Evaluation Report on Subjective Competitiveness of World-Class Universities and Research Institutions

23/4/12 RCCSE 4

• ②A Report on the Competitiveness Evaluation of Universities and Subjects in China

23/4/12 RCCSE 5

• ③An Evaluation Report of Postgraduates Education in China

23/4/12 RCCSE 6

•④ A Report on Chinese Academic Journals Evaluation

23/4/12 RCCSE 7

• Now please allow me to give a brief

introduction of the reports.

• I am glad to share the methods and results of

Chinese universities’ evaluation released by

RCCSE, based on the “Chinese Universities

Ranking in 2010”.

23/4/12 RCCSE 8

contents

Purposes and Significance 1

Evaluation Subjects2

Data Sources

4

Results Analysis5

Methods and Index System3

23/4/12 RCCSE 9

1. Purposes and Significance

Providing guide for the students to

choose the suitable university.

Providing opportunity for the public

to gain information of universities.

23/4/12 RCCSE 10

1. Purposes and Significance

Providing reference for the universities

to develop with orderly competition.

Providing support for the government to

make a strategic and scientific decision.

23/4/12 RCCSE 11

2. Evaluation Subject

• Undergraduate-level universities that

licensed by the Education Ministry

• Each year the Education Ministry issues

the latest “Chinese Universities List”.

• The universities in our evaluation are in

accordance with this official list.

23/4/12 RCCSE 12

2. Evaluation Subject

• All universities in our evaluation are

divided into three kinds:

key university

average university

private college

23/4/12 RCCSE 13

Key University

• Key universities consist of three parts:

The original key universities in the

“Statistical Document of 2003” issued by

the Education Ministry;

The ministry-run universities;

Members of the "211 project" and "985

project”.

23/4/12 RCCSE 14

3.1 Methods

QuestionnaireIn 2004 RCCSE and China Youth Daily jointly

conduct a nationwide survey covering 2000

people, including the leaders of educational

authorities, presidents and teachers of

universities, senior high school students and

their parents, experts and scholars in

evaluation field, etc.

23/4/12 RCCSE 15

3.1 Methods

AHP(Analysis Hierarchy Process)

Based on the results of the survey

above, we obtained the evaluation

indicators and weights by the way of

AHP.

23/4/12 RCCSE 16

3.1 Methods

Experts Discussion

Then we invited some leading experts

and scholars to have a full discussion on

these indicators and weights. Finally we

obtained the index systems of Chinese

Universities Evaluation.

23/4/12 RCCSE 17

3.1 Methods

Evaluation Information Management System

We import the original data into “Chinese Universities

Evaluation Information Management System” which

can automatically realize the functions of computing,

statistics and sort.

The system, which was designed and developed by

RCCSE independently, can undertake most of data

processing work and give us the final evaluation

scores and rankings automatically.

23/4/12 RCCSE 18

3.2 Index System

• Comprehensive competitiveness of a key university represents its overall appearance integrated by quantity, quality, level and impact.

• We evaluate them from different aspects: resources, teaching, R&D and reputation.

• This index system has 4 first-grade indicators, 13 second-grade indicators and 50 third-grade indicators.

23/4/12 RCCSE 19

23/4/12 RCCSE 20

23/4/12 RCCSE 21

23/4/12 RCCSE 22

• Academic reputation is derived from the survey covering thousands of experts and scholars in the relevant fields.

• Web influence is measured by web output, links,etc. Original data is from Google Scholar and Yahoo!, etc.

23/4/12 RCCSE 23

4. Data Sources

• We spend a lot of time, funds and

manpower on original data collection.

• After several years’ exploration, we have

established relatively stable and reliable

data access channels.

• Most original data comes from the

following 4 channels:

23/4/12 RCCSE 24

Data Sources

① Official documents, including statistical reports,

yearbooks and government documents;

② Domestic and foreign databases, including

SCI, SSCI, EI, CSSCI, etc;

③ Websites of universities and governments;

④ Relevant publications, including books,

newspapers and journals.

23/4/12 RCCSE 25

5.Results Analysis

• Our evaluation in 2010 contains 980

universities in Chinese mainland

(excluding military universities), including

119 key universities, 599 average

universities and 262 private colleges.

23/4/12 RCCSE 26

5.Results Analysis

• We evaluate these 980 universities from 10 aspects and obtain 201 rankings (specific rankings are listed in the book of “Chinese Universities and Subjects Evaluation Report in 2010”, Science Press, 2010.3).

• Here we only show the “Regions Competitiveness Ranking of Chinese Higher Education” and “ Chinese Top-grade Universities Competitiveness Ranking”.

23/4/12 RCCSE 27

5.1Regions Competitiveness Ranking of Chinese Higher Education

23/4/12 RCCSE 28

5.1Regions Competitiveness Ranking of Chinese Higher Education

23/4/12 RCCSE 29

5.1Regions Competitiveness Ranking of Chinese Higher Education

23/4/12 RCCSE 30

5.2 Chinese Top-grade Universities’ Competitiveness Ranking

• “Chinese Top-grade Universities” are those

who have first-class scholars, first-class

subjects, first-class achievements, first-

class efficiency, first-class management.

• We select the top one percent universities

as the Top-grade universities in China, that

is, a total of about 20 universities.

23/4/12 RCCSE 31

Chinese Top-grade Universities’ Comprehensive

Competitiveness Ranking in 2010

23/4/12 RCCSE 32

Chinese Top-grade Universities’ Comprehensive Competitiveness Ranking in 2010

23/4/12 RCCSE 33

5.3 Conclusions

The distribution of universities is

disequilibrium in different regions.

Most universities, especially those key

universities, centralize in the central

and eastern part of China, such as

Beijing, Shanghai, Nanjing, Wuhan etc.

23/4/12 RCCSE 34

5.3 Conclusions

The education competitiveness is equal

with the economic strength of the region.

For example, some rich regions, such as Beijing,

Shanghai and Jiangsu, are listed at the top of

“Regions Education Competitiveness Ranking”.

Conversely poor regions also have poor

education competitiveness, such as Tibet,

Ningxia, Qinghai and so on.

23/4/12 RCCSE 35

5.3 Conclusions

The ranking of key universities is stable

while the ranking of average universities is

fluctuated dramatically.

For example, Peking University, Tsinghua

University, Zhejiang University and Fudan

University have been retaining its position as

Chinese top 4 for recent six years.

23/4/12 RCCSE 36

5.3 Conclusions

Key universities, average universities

and private colleges lie in three levels

and respectively have different

targets and emphasizes.

23/4/12 RCCSE 37

5.3 Conclusions

The main directions of Chinese universities are high quality, efficiency and internationalized level.

We deduce this enlightenment from the

Chinese universities evaluation results in

2010 and the data accumulated by RCCSE

over the years.

23/4/12 RCCSE 38

• Above all, Chinese universities, especially key universities must adhere to the directions of “high quality, efficiency and internationalized level” to promote their competitiveness and to propel the development of Chinese higher education.

High quality

Efficiency

Internationalized level

23/4/12 RCCSE 39

Thanks!