state matura in croatia milestones and...
Post on 21-Jun-2018
219 Views
Preview:
TRANSCRIPT
State Matura in Croatia – Milestones and Challenges
Maja Jukić, director of National Centre for External External Evaluation of Education, Croatia
Belgrade, December 15, 2014
National Center for External Evaluation of Education
= public institution responsible for external evaluation of pre-tertiar education system in Republic of Croatia, including student assessment
Objectives of external evaluation: to establish a system for improving the quality of education and to establish a system of standardized evaluation of knowledge and skills – competencies
National Center for External Evaluation of Education
Some of the NCEEE responsabilities:
• Research and preparation of national standards and exam materials
• Conducts international student achievement tests and surveys
• Coordinates the work of all participants responsible for conducting national exams (task forces, reviewers, exam coordinators, evaluators)
• Organizes and conducts training of afore-mentioned groups
• Organizes and conducts national exams and State Matura (print, distribution)
• Processes and analyzes results, makes proposals for modifications
• Provides training for all participants to use results and to introduce modifications in the system
STATE MATURA
• is basically SUMMATIVE test
• has to provide standardized
evaluation of knowledge and skills
of senior-year students at the end
of their secondary education
• also has FORMATIVE purpose:
basis for improving educational
system and for initiating self-
evaluation process in schools
STATE MATURA – development path
• First scientific elaboration and plan for introducing of State Matura in
Croatian education system was written by educational experts in 2003
• In 2005 Ministry of Science, Education and Sport of Republic of Croatia
founded an operative unit which goal was preparation of the whole
education system for the introducing of State Matura
• First content method groups for the test construction started with work in
2005
• By 2007 all the content method groups for all the subject fields were
formed
• Each content method group have had 4 – 6 members (one is a university
representative; other ones are experienced teachers)
• Their first task was putting together exam catalogues
– Educational outcomes
STATE MATURA – development path
•In 2009 “trial” State Matura was administered
•In 2010 State Matura become regular part of the Croatian education system
•During the last five years some slight changes occurred in the examination
technology (most of them in the last administration)
• Compulsory for Grammar school students (from 2009/2010) - a
certificate of completion of secondary education
• Elective for vocational schools students – they access to State
Matura exams only to ensure enrollment at the universities
• Two terms: summer and autumn
• Conditions: standardized test administration under the supervision
of independent parties (university profesors or educational
agencies staff)
• Location: schools, examination centers in 5 cities in Croatia
STATE MATURA
• State Matura consists of mandatory and elective part
• State Matura is the same for everyone, meaning that all
students have to take mandatory exams from Math, Croatian
language and Foreign language at elementary or higher level
• 37 exams
STATE MATURA
STATE MATURA
• Elective part of State Matura consists of taking subjects that students
selected by themselves
• Students can choose any number of 30 offered elective exams
• The choice of exams is primarily determined by the admission criteria
required by the tertiary education institutions (e.g. students who want to
enroll in School of Medicine should take Physics, Chemistry and Biology)
STATE MATURA - Exams
• In the elective part of State Matura, students can take exams from the following subjects:
• English, French, German, Spanish, Italian, Classic languages (Ancient Greek and Latin), Biology, Ethics, Philosophy, Physics, Geography, Musical Art, Information Technology, Chemistry, Visual Arts, Politics and Economy, History, Psychology, Sociology, and Religion
• Foreign languages exams could be taken in the optional part of State Matura at advanced level only
• Latin exam can be taken at advanced or elementary level
• Exams from Greek and other subjects in the optional part of State Matura have no levels
STATE MATURA - specific adjusments
• students of classic comprehensive schools, under mandatory part of exam of State Matura, can take an exam from Latin or Ancient Greek instead of foreign language exam
• Students educated using the language and script of ethnic minorities, under mandatory part of State Matura have to take an exam from the ethnic minority language (plus Croatian language exam)
STATE MATURA - accomodations and modifications
• Exam accommodations and modifications are available for special needs students
• i.e. In the summer term 2013/2014, 469 applicants had right to take adapted exams
– 104 of that number had expert support assistants
– 10 different exams for 8 candidates were made in Braille
– in the autumn term 2013/2014: 110 applicants, of whom 44 had expert support assistants
STATE MATURA - Scoring
Each exam is consisted both of closed and open-ended items
•Some exams (Croatian and foreign languages, Philosophy, Ethics,
Visual Art) contain essay question, as well
•Croatian language essay is scored independently by the two raters
(trained teachers)
– If they differ significantly, the essay goes to the third rating
which is made by the content method specialist and his/her rate
is final
•The price for rating of an exam vary on number and types of open-
ended items
– There are defined unit prices for each type of open-ended item
STATE MATURA - Milestones
•Teachers and students have started to teach and learn in terms of educational outcomes
•We have tests that are standardized (more or less)
•Connection between secondary and tertiary education
•Tool for improvement of education system
STATE MATURA - Challenges
• Reconsideration of State Matura goals
– Certification vs. Entrance exam
• According to Standards (APA, AERA, NCME),
test MUST NOT have multiple purposes
• Higher level of exam standardization
– Pretested items
– Item bank
– Pre-set standards of student achievement
STATE MATURA - Challenges
• Moving toward using exams in a more formative manner
• Introducing of innovative item formats that will allow us to measure key competencies and higer-level cognitive functions
• E-assessment
• Establishing protocols and procedures for quality assurance
according to the international standards (International Test
Commission)
• Continuous improvements based on validity research
• Certification of achieved vocational qualifications and
mobility ensuring towards higher education in a related field
of work
Lesson that we have learned...
•Once the procedures and techniques for exam preparation and administration are set, huge efforts are necessary to modify them
•Good communication with all stakeholders within the system is crucial in order to get support for making improvements
Thank you!
maja.jukic@ncvvo.hr
Comparison between some previous and recent data
Mandatory exams
School year 2009./2010. 2010./2011. 2011./2012. 2012./2013. 2013./2014.
Number of
candidates
In total 33.577 32.181 33.019 33.786 33.262
Gimnasium %37 %36 %37 %37 %40
VET schools %50 %51 %50 %51 %47
Others %13 %13 %13 %12 %13
Exam Number of
attenders
Number of
successful
att.
% of
successful
att.
Croatian Language A 24 689 22 341 90,49 %
Croatian Language B 11 188 9 076 81,12 %
Math A 11 072 10 178 91,93 %
Math B 25 562 21 949 85,87 %
Foreign language A 18 375 16 758 91,20 %
Foreign language B 14 941 12 645 84,63 %
French A 98 78 79,59 %
French B 6 3 50,00 %
German A 1 152 999 86,72 %
German B 1 780 1 512 84,94 %
Spanish A 124 111 89,52 %
Spanish B 3 3 100,00 %
Exam Number of
attenders
Number of
successful
att.
% of
successful
att.
Italian A 387 344 88,89 %
Italian B 40 34 85,00 %
Greek 43 39 90,70 %
Latin A 56 55 98,21 %
Latin B 51 46 90,20 %
Hungarian (maternal) 8 8 100,00 %
Serbian (maternal) 171 167 97,66 %
Italian (maternal) A 69 67 97,10 %
Italian (maternal) B 56 55 98,21 %
Biology 7 672 6 836 89,10 %
Ethic 74 48 64,86 %
Philosophy 447 369 82,55 %
Physics 9 025 8 092 89,66 %
Geography 651 535 82,18 %
Exam Number of
attenders
Number of
successful att.
% of
successful att.
Music Art 32 24 75,00 %
Informatics 2 718 2 358 86,75 %
Chemistry 3 760 3 423 91,04 %
Art 1 181 1 019 86,28 %
Logic 194 168 86,60 %
Politic and economy 8 624 7 718 89,49 %
History 1 503 1 265 84,17 %
Psyhology 5 085 4 575 89,97 %
Sociology 1 321 1 162 87,96 %
Chatechizm 191 161 84,29 %
Negative grade on state matura Number of students
% students
1 mandatory exam 211 98,14 %
2 mandatory exams 4 1,86 %
215 100,00 %
Mandatory exam Number % students
Croatian Language A 25 11,42 %
Croatian Language B 2 0,91 %
Math A 91 41,55 %
Math B 62 28,31 %
Foreign language A 5 2,28 %
Foreign language B 31 14,16 %
Greek 2 0,91 %
Latin A 1 0,46 %
219 100,00 %
Grade
1 2 3 4 5
High school students
25 302 5 253
5 272
1 037
Candidate 54 401 832 163 13
Foreign students
9 83 371 123 22
Vocational school students
282 1 940
5 295
830 34
370 2 726
11 751
6 388
1 106
Grade
1 2 3 4 5
High school students
2 32 535 672 69
Candidate 14 43 189 40 0
Foreign students
1 19 141 50 3
Vocational school students
514 1 292
4 809
645 6
531 1 386
5 674
1 407
78
Grade
1 2 3 4 5
High school students
94 1 363
2 978
1 444
724
Candidate 199 337 196 56 17
Foreign students
64 196 156 25 9
Vocational school students
401 1 063
662 173 21
758 2 959
3 992
1 698
771
Grade
1 2 3 4 5
High school students
64 984 2 986
2 100
448
Candidate 202 723 518 131 20
Foreign students
27 145 167 39 6
Vocational school students
1 800
5 847
4 564
1 084
94
2 093
7 699
8 235
3 354
568
Grade
1 2 3 4 5
High school students
5 186 3 013
5 034
1 941
Candidate 18 154 571 323 63
Foreign students
6 64 230 118 15
Vocational school students
46 559 2 840
1 406
166
75 963 6 654
6 881
2 185
Grade
1 2 3 4 5
High school students
31 324 994 856 357
Candidate 117 197 192 86 36
Foreign students
18 89 113 63 24
Vocational school students
1 029
2 898
3 359
1 560
302
1 195
3 508
4 658
2 565
719
top related