assessment: pumpkin or glass slipper? · glass slipper? ib mission statement . the ib aims to...
TRANSCRIPT
![Page 1: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/1.jpg)
![Page 2: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/2.jpg)
Assessment: pumpkin or glass slipper?
Richard Penrose, head of marking
![Page 3: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/3.jpg)
Pumpkin?
![Page 4: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/4.jpg)
Glass slipper?
![Page 5: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/5.jpg)
IB mission statement The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better and more peaceful world through intercultural understanding and respect. To this end the IB works with schools, governments and international organizations to develop challenging programmes of international education and rigorous assessment. These programmes encourage students across the world to become active, compassionate and lifelong learners who understand that other people, with their differences, can also be right.
![Page 6: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/6.jpg)
10 features of good assessment
• Validity • Reliability • Comparability • Manageability • Minimising bias
• Backwash effect • Fairness • Public confidence • Security • Transparency Isabel Nisbet (Cambridge Assessment; former Ofqual chief executive)
![Page 7: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/7.jpg)
Authentic tasks that assess what they are designed to assess. • Assessment research and design team in den
Haag global centre
Validity
![Page 8: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/8.jpg)
SUBJECTOPERATIONS
EXAMINER RECRUITMENT
&TRAINING
ASSESSMENT QA
RESEARCHIN
ASSESSMENTDESIGN
SUBJECT MANAGEMENT
EXAMINATION PAPER
PREPARATION
ASSESSMENT MATERIAL
ADMINISTRATION
IBIS ADMINISTRATION (including academichonesty and specialeducational needs)
BUSINESS INTEGRATION
CAO
Head
of
Mar
king H
ead of
Assessment
Design & Innovation
Head of School Delivery
ASSESSMENT DESIGN
AND INNOVATION
MARKING
SCHOOL DELIVERY
![Page 9: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/9.jpg)
Consistency of assessment outcome regardless of examiner, session, language, etc. • Trialling of assessments during curriculum
review • E-marking with seeding • Seeding to quality assure internal assessment
moderation
Reliability
![Page 10: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/10.jpg)
• IB provide data about components and candidates to RM Education for upload into scoris™
• Scripts sent from schools to scanning centre (UK or US) • Scripts scanned and made available to examiners in
scoris™ • Component senior team set-up practice, qualification
and seed scripts • Examiners ‘qualify’ to mark and are quality assured
during marking • Raw marks are final (unmoderated) marks in IBIS
E-marking with seeding
![Page 11: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/11.jpg)
E-Marking: Examiners’ Script View
![Page 12: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/12.jpg)
Benefits to IB of e-marking
• Examiner marking is visible • Underperforming examiners are coached or
removed from the session • Re-allocation is rapid – no script movements • Less clerical checking – Scoris does the sums • Examiners mark to the PE standard • No frenzy of re-marking inconsistent examiners • Standardisation and Grade Award meetings can be
remote
![Page 13: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/13.jpg)
Benefits to candidates and schools of e-marking
• Wealth of data on candidate performance available (IBResultsExtra)
• Digital return of EURs • Candidate’s work is marked anonymously,
removing risk of examiner bias • Examiner work is constantly compared to the PE
standard • IB exam delivery can scale at the rate of IB growth • Negligible risk of losing scripts
![Page 14: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/14.jpg)
74.46%
79.34% 77.51%
88.65%
81.89% 81.64% 84.58%
79.55%
72.17%
82.09% 82.57% 85.65%
83.15%
89.44%
83.05% 81.90%
73.89%
86.88% 82.30%
73.35%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Simulation marking Practice scripts Entering marks Adding comments Communication tools e.g. sending a message to your Team Leader
Provision of quality automatic feedback from seeds (the ability to view the Principal Examiner's seed
alongside your own)
Positive M11
Positive M12
Examiner Feedback May 2012 e-marking questionnaire
![Page 15: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/15.jpg)
Moderator downloads sample of 3
Teacher's marks within
tolerance
Teacher's marks stand for all candidates
Moderation applied to all candidates
Teacher's marks
consistent
Teacher's marks outside
tolerance
Moderator downloads 2-7
more
Dynamic Sampling™ for IA e-marking
![Page 16: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/16.jpg)
Consistent standards over time and across subjects • Comparability study of large entry subjects • Comparability study of low entry language A1s
Comparability
![Page 17: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/17.jpg)
Practicality for students, schools, examiners, IB • Tightening of assessment policy (4
components at HL and 3 at SL) • E-coursework upload • Scanning centres
Manageability
![Page 18: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/18.jpg)
• All script / material movements are digital – No postage costs – Nothing gets lost in the post – Nothing gets stuck at customs
• Ease of plagiarism checks, for school and IB • Errors in submission can be corrected by candidate and
school before submission • Upload process requires authentication of candidate work • Dovetails with e-marking • Multi-media upload provides new possibilities for
assessment tasks to curriculum review teams
Benefits of E-coursework upload
![Page 19: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/19.jpg)
Visual arts e-portfolio
• Pilot in May 2012 and November 2012 • All schools from May 2013 • Communication and support via conferences,
OCC, workshops and dedicated email address ([email protected])
• Comparability study • More support and information coming...
![Page 20: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/20.jpg)
Ensuring particular groups of candidates are neither advantaged nor disadvantaged in assessment outcomes for reasons other than their learning • Culture • Gender • Language
Minimising bias
![Page 21: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/21.jpg)
The effect of summative assessments on teaching and learning • engineering in positive backwash effect on
teaching and learning – that intended by the curriculum developers.
Backwash
![Page 22: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/22.jpg)
Alec Peterson, Schools Across Frontiers
“What is needed is a process of assessment which is as valid as possible, in the sense that it really assesses the whole endowment and personality of the pupil in relation to the next stage of his life, but at the same time sufficiently reliable to assure pupils, parents, teachers, and receiving institutions that justice is being done. Yet such a process must not, by its backwash effect, distort good teaching, nor be too slow, nor absorb too much of our scarce educational resources.”
![Page 23: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/23.jpg)
Richard Penrose
“No other external factor has a greater effect on the quality of a student’s learning than the quality of teaching and no other external factor has a greater effect on the quality of teaching than the nature of the final assessment of the student.”
![Page 24: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/24.jpg)
Accessibility • engineering out barriers to particular learners
such as those with diverse linguistic backgrounds or disabilities
Fairness
![Page 25: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/25.jpg)
Trust in the meaningfulness of qualifications and the organisations that award them
Public confidence
![Page 26: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/26.jpg)
Leana Lyn Doray, Straits Times
“Our education system must focus less on repeating what is known, and more on learning to identify and resolve the unknown. Hopefully, this will equip Singapore with the skills to cope with future scenarios that cannot be anticipated now. I have no doubt that whatever Singapore collectively puts its mind to, it can achieve, and I hope we will move forward with an education system that looks to our future rather than our past.”
![Page 27: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/27.jpg)
Prevention of cheating, maintenance of confidentiality • Timezoned examination papers • School connections • Anonymity of candidates/schools in e-marking • Investigation of suspicions raised by examiners
and others
Security
![Page 28: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/28.jpg)
The openness of the awarding organisation • Three categories of enquiry upon results • New re-moderation service • Teacher observers
Transparency
![Page 29: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/29.jpg)
0
500
1000
1500
2000
2500
-12 -11 -10 -9 -8 -7 -6 -5 -4 -3 -2 -1 0 1 2 3 4 5 6 7 8 9 10 11 12 >12
Freq
uenc
y
Overall mark changes
Frequency of mark changes at re-marking
![Page 30: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/30.jpg)
• Return of externally assessed material to schools
• Examiners only required to make comments on scripts that support them in their arrival at an accurate mark
• Markschemes to be sent out with returned material from 2013
Category 2 Enquiry Upon Results
![Page 31: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/31.jpg)
• Re-moderation of internal assessment available for the first time in 2012.
• Replaced internal assessment moderation report (IMR) of which schools were critical
• 20% adjustment threshold for 2012. 15% for 2013.
• Moderation of internal assessment to be overhauled in 2014
Category 3 Enquiry Upon Results
![Page 32: Assessment: pumpkin or glass slipper? · Glass slipper? IB mission statement . The IB aims to develop inquiring, knowledgeable and caring young people who help to create a better](https://reader035.vdocuments.us/reader035/viewer/2022070107/6023a84bfee6ec2a055f0287/html5/thumbnails/32.jpg)
Questions?