connecting the dots between the isr and the...
TRANSCRIPT
Connecting the Dots Between
the ISR and the DSR/SSR
Yu-Feng [email protected]
Sarah [email protected]
Redesigned Individual Student Reports (ISRs)
for MCA & MTAS
• Improved graphics, new format & design
• Grades 5 & 8 on one ISR
• All 3-subjects (R,M,S)
• Grades 3,4,6 & 7 on one ISR
• 2- subjects (R/M)
• ISR for each HS subject/grade
• Updated text describing results
New and Redesigned ISR Resources
• Full Interpretive Guide with improved format
• More graphics and concise descriptions
• MCA & MTAS ISR Quick Guides
• MCA & MTAS ISR Videos
New District and School Student
Results File Format (DSR/SSR)
• Updated columns and fields in file
• Updated file format documents for old and new formats
• Two help tabs
• Column definitions and Score label descriptions
• New format has two new Student Groups
• ‘SLIFE’ and ‘Homeless’
• Students with Limited or Interrupted
Formal Education (SLIFE)
• Old DSR/SSR format still available
• Phased out by 9/1/17
New Results IncludedAdditional fields included for 2015-2016 MCA
• Growth for Grades 4-8
(Low, Medium/Average, High)
• Strand Performance Level Descriptor
(Below Expectations, At or Near Expectations,
Above Expectations)
• Career and College Readiness (CCR) HS indicators
• Redefined Progress Scores for Grades 3-8
MCA Performance Level and Standards• Example of a 3-subject MCA ISR
• Reading ‘Meets’, Mathematics ‘Exceeds’, Science ‘Meets’
• Description about performance on standards
• A student’s performance described in relation to peers in the state
• Growth level for Reading and Math, but not Science
Results Comparisons
• Scale scores of student vs averages at school, district, and state level
Finding Results on ISR in DSR/SSR
• Student scale score vs averages at school, district, and state.
Finding Results on ISR in DSR/SSR
• Participating students in grades 4-8 Reading and/or Math MCA
• Only growth level is included (based on Minnesota Growth Model)
• Growth level – L (Low), M (Medium/Average), or H (High)
• See page 20 of New DSR/SSR File Format Document for which reports
to find more growth information
Strand Performance Level on ISR
• Strand performance levels are on ISR for MCA Reading G3-
8 & G10, Math G3-8 & G11, and Science G5, G8 & HS
Strand Performance Level on DSR/SSR
• Strand scale score:
Strand Scale Score and Standard Error of
Measurement (SEM) on DSR/SSR
• SEM of strand scale score:
Strand Performance Level on ISR and
Strand & Substrand Performance Level on DSR/SSR for MCA
Science HS
• Two strand performance levels
on ISR:
• Two strand performance levels
and scale scores on DSR/SSR:
Strand Performance Level on ISR and
Strand & Substrand Performance Level on DSR/SSR for MCA
Science HS
• Seven sub-strand performance levels and scale scores on DSR/SSR:
Calculation for Strand Scale Score and
Strand Performance Level
Scoring Method:
The item parameters and the student's answer pattern
Strand theta score and strand standard error of measuremnt
(SEM) for theta
Strand scale score and SEM for strand scale
score
Using the strand theta score and SEM
for theta to determine the strand
performance level
Determining the Strand Performance Level
• The confidence band (lower & upper confidence limit) using the
strand theta score and SEM of strand theta score is calculated to
determine the strand/substrand performance level.
Determining the Strand Performance Level
• Above Expectations: Lower CI> Target Theta Score
• At or Near Expectations: Lower CI ≤ Target Theta Score ≤ Upper CI
• Below Expectations: Upper CI< Target Theta Score
Performance History and Progress Score for
MCA Math & Reading G3-8 on ISR
• Student Progress Score (Vertical Scale Score)
Progress Score for MCA Math & Reading G3-8 on DSR/SSR
Scoring for Progress Score (Math & Reading G3-8)
• Both the on-grade and off-grade items for G3-8 Reading & Math MCA will be
used to calculate the progress score.
• Off-grade items:
• Any off-grade level items will be no more than two grade levels above
or below a student’s grade.
• EX: Fifth grade students may see items from any of grades 3, 4, 5,
6, 7.
• The exception to this are grades 3 and 8 because there are no items
below grade 3 and no items above grade 8.
• EX: Third grade students may see on-grade items or above-grade
items (4 or 5 grade items) and eighth grade students may see on-
grade items or below-grade items (6 or 7 grade items).
Interpretation for Progress Score (Math & Reading G3-8)
For MCA Math and Reading Grades 3-8:
• If the progress score is at or above the goal progress scores at each grade, it
is projected to be on track for next grade’s coursework.
• If the progress score is below the goal progress scores at each grade, it is not
projected to be on track for next grade’s coursework.
Career and College Readiness (CCR) for MCA
Math G11 and Reading G10 on ISR
• For MCA Reading G10:
• For MCA Math G11:
Interpretation for CCR
(Math G11 & Reading G10)• The CCR Goal Score for Math G11 and Reading G10 is an indicator that
performance is on track to demonstrate career and college readiness on a
college entrance exam at the end of grade 11.
• Student scale scores at or above the CCR Goal Score may indicate
student’s performance is on track to meet career and college
readiness.
• Student scale scores below the CCR Goal Score may indicate student’s
performance is not on track to meet career and college readiness.
Performance History for MCA Science G5 & G8 on ISR
• For MCA Science G8:
• For MCA Science G5:
Goal Progress Score (Math & Reading G3-8) and CCR Goal Score
(Math G11 & Reading G10) on ISR and DSR/SSR
• On the ISR:
Goal Progress Score (Math & Reading G3-8) and CCR Goal Score
(Math G11 & Reading G10) on ISR and DSR/SSR
• DSR/SSR New File Format Information file:
• On the Page 17: • On the Page 18:
Final Page of ISR Information
• Additional information about assessments
For More Information - ISR
• MCA & MTAS ISR Quick Guides
• Understanding the MCA & MTAS ISR Videos
• MCA & MTAS Sample Individual Student Reports
• http://minnesota.pearsonaccessnext.com/isr/
For More Information – DSR/SSR
• DSR/SSR information:
• MDE > School Support > Data Submissions >
Assessment Secure Reports
• 2015-2016 OLD District and School Student Results
(DSR and SSR) File Format Information
• 2015-2016 NEW District and School Student Results
(DSR and SSR) File Format Information
Questions?