ranking tertiary education systems jamil salmi astana 15 june 2009
TRANSCRIPT
![Page 1: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/1.jpg)
Ranking Tertiary Education Systems
Jamil Salmi
Astana 15 June 2009
![Page 2: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/2.jpg)
Benchmarking Tertiary Education Systems
Jamil Salmi
Astana 15 June 2009
![Page 3: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/3.jpg)
3
![Page 4: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/4.jpg)
4
the power of rankings
• public debate– Malaysia
– France
– Brazil
![Page 5: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/5.jpg)
5
institutional behavior
• positive reactions– increased data-based decision making
– improvements in teaching and learning practices
– mergers or institutional collaboration
![Page 6: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/6.jpg)
6
institutional behavior (II)
• negative reactions– less interest for low-income and minority
students
– distorted resource allocation to favor research over teaching
– neglect of established institutional research practices
– managing to the rankings (cheating?)
![Page 7: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/7.jpg)
7
outline of the presentation
• world-class university or world-class tertiary education system?
• rankings of university systems
• benchmarking tertiary education systems
![Page 8: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/8.jpg)
8
the search for excellence
my university is…
more world-class than yours
![Page 9: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/9.jpg)
9
the WCU disease
• governments
• institutions– strategic efforts
– lobbying for resource concentration
![Page 10: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/10.jpg)
10
![Page 11: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/11.jpg)
11
the WCU disease
• governments
• institutions
• World Bank
![Page 12: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/12.jpg)
![Page 13: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/13.jpg)
13
how do you recognize a world-class university?
• everyone wants one
• no one knows what it is
• no one knows how to get onePhilip G. Altbach
![Page 14: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/14.jpg)
14
![Page 15: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/15.jpg)
15
reality check
• well-performing countries without world-class universities– and vice-versa
![Page 16: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/16.jpg)
16
top 50 universities
![Page 17: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/17.jpg)
comparison of rankings
WEF WB K4D SJTU
USA Denmark US (1)
Switzerland Sweden UK (4)
Denmark Finland Japan (19)
Sweden Netherlands Switzerland (24)
Singapore Norway Canada (24)
Finland Canada France (42)
Germany Switzerland Denmark (45)
Netherlands UK Netherlands (47)
Japan USA Sweden (51)
Canada Australia Germany (55)
17
![Page 18: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/18.jpg)
18
reality check
• well-performing countries without world-class universities
• time dimension of alignment?– emerging economies vs. mature economies
• country size– Harvard vs. Canada
![Page 19: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/19.jpg)
19
reality check
• institutional differentiation– different types of institutions for meeting
various learning and training needs
– regional engagement
– technology transfer through human capital formation
![Page 20: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/20.jpg)
20
![Page 21: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/21.jpg)
21
evolution of Nokia income
![Page 22: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/22.jpg)
22
outline of the presentation
• world-class university or world-class tertiary education system?
• rankings of university systems
![Page 23: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/23.jpg)
23
SJTU ranking (2008)Country Ranking Country
Rank of Top University in Country
1 USA 1 2 UK 4 3 Japan 19 4 Switzerland 24 4 Canada 24 6 France 42 7 Denmark 45 8 Netherlands 47 9 Sweden 51 10 Germany 55 11 Australia 59 12 Norway 64 13 Israel 65 14 Finland 68 15 Russia 70
16-20 Belgium, Brazil, Italy, Singapore
101 – 151
21-26 Argentina, Austria, Mexico, Spain, South Korea, Taiwan
152 – 200
27-33 China, Czech Republic, Greece. Hong Kong, Ireland, New Zealand, South Africa
201 – 302
34-36 Hungary, India, Poland 303 – 401 37-40 Chile, Portugal, Slovenia,
Turkey 402 – 503
![Page 24: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/24.jpg)
adjusting for size
24
![Page 25: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/25.jpg)
University World News
25
![Page 26: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/26.jpg)
SJTU
26
![Page 27: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/27.jpg)
QS SAFE National System Strength Ranking
• US• UK• Australia• Germany• Canada• Japan• France• Netherlands• South Korea • Sweden
• number & ranking• access to top U• flagship U• investment
27
![Page 28: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/28.jpg)
28
![Page 29: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/29.jpg)
Lisbon Council
29
• ranking of university systems (17 OECD countries)
• beyond research• multi-dimensional (access and
completion, labor market outcomes, lifelong learning, responsiveness, ability to attract foreign students)
• pioneer work
![Page 30: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/30.jpg)
limitations
• face same methodological questions as university rankings– focus on universities – research bias– composite index with arbitrary weights– statistical robustness– choice of indicators
30
![Page 31: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/31.jpg)
31
outline of the presentation
• world-class university or world-class tertiary education system?
• rankings of university systems
• benchmarking tertiary education systems
![Page 32: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/32.jpg)
32
cross-country comparisons help increase knowledge
is this flower big or small?
it depends on the size of neighboring flowers
![Page 33: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/33.jpg)
33
multi-dimension comparisons enriches the diagnosis
how does this flower compare with the others?
wider but shorter
![Page 34: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/34.jpg)
purpose
• improving performance– through comparisons
• competitors
• good practices
– diagnosis (identification of areas for improvement)
– definition of specific corrective interventions
34
![Page 35: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/35.jpg)
35
purpose (II)
• need to understand the determinants of performance– no consensus on what countries should do to
improve their performance
– wide variations in system performance with similar funding levels and common country characteristics
![Page 36: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/36.jpg)
36
Brazil and Chile
• public spending on tertiary education = .8% and .3% of GDP respectively
• enrollment rates are 24% and 38% respectively
![Page 37: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/37.jpg)
37
why is a comprehensive benchmarking tool important?
• performance is more than– building world-class universities
– enrolling students (equity and quality agenda)
• learning & labor market outcomes linked to the totality of the education experience
![Page 38: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/38.jpg)
38
approach
• elaborating a theoretical framework
• selecting indicators
• finding / generating the data
• analysis– diagnosis (areas for improvement)
– identification of possible solutions
![Page 39: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/39.jpg)
39
preliminary step
• defining a system– US
– EU
– small states
![Page 40: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/40.jpg)
40
elaborating the theoretical framework
• distinction between performance and health of system– how good are the system’s actual outcomes?
– does it operate under conditions known to lead to high performance?
• definition of outcomes / outputs / results
• identification of determinants and causality relationships– informed by empirical evidence
![Page 41: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/41.jpg)
41
results framework
• research production
• technology transfer
• quality and relevance of education and training– labor market outcomes
– measuring learning outcomes
![Page 42: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/42.jpg)
42
results framework
• equity
• values and behaviors
• social and cultural engagement
![Page 43: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/43.jpg)
determinants (inputs and processes)
• access and equity (enrollment, institutional diversification, pathways)
• quality and relevance (standards, teaching and learning, research, local engagement)
43
![Page 44: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/44.jpg)
determinants (inputs and processes)
• sustainable financing (resource mobilization, allocation, efficient use)
• capacity to improve (system and institutional governance)
44
![Page 45: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/45.jpg)
45
indicators and data
• selecting and defining the right indicators
• finding comparable and reliable data (statistical sources and surveys)– objective
– verifiable
![Page 46: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/46.jpg)
46
![Page 47: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/47.jpg)
47
Benchmarking
Tertiary Education
Upgrade your knowledge –
measure, assess and compare your universities!
![Page 48: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/48.jpg)
48
conclusions
• exploratory work
• different type of analysis– who? governments and donors
– what: system lens vs. institutional
• multi-dimensional
![Page 49: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/49.jpg)
49
main challenges ahead
• defining and measuring multiplicity of outputs
• finding reliable data
• linking results and causes to be able to take action
![Page 50: Ranking Tertiary Education Systems Jamil Salmi Astana 15 June 2009](https://reader036.vdocuments.us/reader036/viewer/2022062620/551a539b5503463e778b55c6/html5/thumbnails/50.jpg)