cem (nz) centre for evaluation & monitoring college of education dr john boereboom director...
Post on 19-Jan-2016
218 Views
Preview:
TRANSCRIPT
CEM (NZ)Centre for Evaluation & MonitoringCollege of Education
Dr John BoereboomDirector
Centre for Evaluation & Monitoring (CEM)University of Canterbury
ChristchurchJohn.boereboom@canterbury.ac.nz
Using MidYIS to inform Teaching & Learning
The Centre for Evaluation and Monitoring
• Established in 1999• Part of Canterbury University• Each year about 300 NZ schools and 70 000 students use our
services.• Evaluates and monitors progress of students, subjects and
schools to enable evidence based decision making.• Provides Entrance Tests to assess mathematics, English and
Reasoning Skills for class placement and identifying strengths and areas for development.
• Administers student attitude and engagement surveys to investigate factors that can affect progress.
Why use MidYIS?• League tables are an unfair comparison of schools and do not
recognise the impact a school has on student progress.• Unique value added analysis.• Comprehensive on line easy to understand and share feedback
eg subject, HOD and staff meetings and BOT.• Sound data for evidence based educational decision making at
the student, subject and school levels.• An independent measure of school effectiveness.• Based on international research adapted for NZ.
• Provides value-added measurement from the beginning of Year 9 to the end of Year 11 in about 20 different subject areas.
• Students sit a baseline MidYIS test at the beginning of Year 9. • The first diagnostic feedback is provided to schools and targets are
provided based on national data from the previous year.• At the end of Year 11, CEM receives NCEA results from NZQA.• The predicted scores are compared to the actual NCEA scores and the
value added is calculated.• Comprehensive online feedback is provided to analyse the performance
of: • The individual student• The subject cohort• The school
MidYIS Yr 9Middle Years Information System
What does MidYIS measure?Vocabulary • important to the prediction of all subjects, especially English, foreign
languages and language-related subjects such as history. Mathematics • important for prediction to mathematics and mathematics-related subjects
such as design, technology, science and economics. Non Verbal (Visual) • how well students undertake tasks involving 3-D visualisation, spatial
aptitude and pattern recognition. Non verbal skills are particularly important for predicting to a range of subjects that includes mathematics, visual arts, drama and design.
Skills (Accuracy) • proof reading and perceptual speed and accuracy.
• If a student is performing exactly in line with the average of the students who participated in the MidYIS 9 baseline test then they will have a score of 100.
• A score greater than 100 indicates that the student performed better than average. A score less than 100 means the student performed below average.
• A score of 130 is significantly high (in the top 2.5% of students in MidYIS 9) and a score of 70 is significantly low (in the bottom 2.5% of students in MidYIS 9).
Average = 100 Standard deviation = 15
Targets are based on what is expected from students if they perform similar to students of similar ability the previous year.
The first feedback
Comprehensive online feedback is provided at the:• Student Level • Subject Level • School Level
The second ‘Value Added” feedback
http://www.atlanta.k12.ga.us
How is the value added score calculated?Year 11 NCEA results are combined into a single number (the NCEA discrimination score) using a simple algorithm and plotted against the MidYIS Year 9 results to establish a national regression line which represents the predicted expected performance.
The individual student’s NCEA discrimination score is plotted on the same graph. The vertical distance between this score and the regression line represents the value added scores.
Value added scores are standardised:
The concept of Value Added
Beyond Expectation+ve Value-Added
In line with Expectation0 Value-Added
Below Expectation-ve Value-Added
http://www.slideshare.net/RobertLeneway/acl-curinstassess
The Student Report
The Subject Report
The School Report
The comprehensive on-line feedback can be used to:
• Identify student strengths and weaknesses and set realistic and motivational targets;
• Identify students requiring support at the individual subject level or across a range of subjects;
• Identify and share best practice and measure teachers’ influence on the academic growth rates of students;
• Identify high achievers or under-aspirers;• Inform departmental planning and the School Improvement
Plan;• Determine where curriculum and instruction is having the
greatest impact on student learning;• Evaluate the effectiveness of programs.
How can schools use the feedback?
What about SES?Each student serves as his or her control and thus eliminates factors like socio economic status that may affect the learning outcomes of students.
“Given similar student abilities, the choice of school a student attends is not among the more powerful influences on later achievement.”
Hattie, J. (2002) Schools Like Mine: Cluster Analysis of New Zealand Schools Technical Report 14, Project asTTle, University of Auckland
Other services provided by CEMStudent attitude surveys• Student Welfare & Safety• Non-academic activities• Support• Social and personal development• Extent of Bullying• Extent of Racism• Healthy Lifestyles
School entrance tests• Mathematics, English and Reasoning skills
YeLIS and SeLIS
top related