![Page 1: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/1.jpg)
An Empirical Investigation of Ohio’s Educator Evaluation System
Authors: Anirudh V.S. Ruhil (Ohio University) <[email protected]> Marsha S. Lewis (Ohio University) <[email protected]> Lauren Porter (The Ohio State University) <[email protected]> Emily A. Price (Ohio University) < [email protected]>
![Page 2: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/2.jpg)
Overview
• Two question motivate our study:– What does Ohio’s educator evaluation system look like?– Any systematic patterns (conditional\unconditional)?
• OTES\OPES • eTPES Data• Analysis and Findings• Conclusions
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)
![Page 3: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/3.jpg)
OTES (2014-2015)
11/08/13
(1) Performance Standards (50%)-- Developed by OH Educator Standards Board-- Seven Components
1: Students2: Content3: Assessment4: Instruction5: Learning Environment6: Collaboration and Communication7: Professional Responsibility and Growth
(2) Student Growth Measures (50%)-- Value-Added-- Approved Vendor Assessments-- LEA Measures
MWERA Annual Meeting 2013 (Evanston, IL)
![Page 4: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/4.jpg)
Student Growth Measures in OTES
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)
(A) Value-Added-- Grades 4th – 8th, ELA & Math -- Until June 30, 2014, majority (>25%) of SGM shall be based on Value-Added-- On or after July 1, 2014, all (50%) of SGM shall be based on Value-Added.
(B) Approved Vendor Assessments-- Terra Nova-- ACT End-of Course-- NWEA MAP -- STAR -- …
(C) LEA Measures -- Student Learning Objectives-- Shared Attribution
-- LEA\School-level Value-Added-- LEA\School-level SLO
![Page 5: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/5.jpg)
OPES (2014-2015)
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)
(1) Performance Standards
-- Shared vision, establish goals, and continuous improvement-- HQ instruction -> increased student achievement-- Manage resources\operations-- Establish collaborating learning and shared leadership-- Engage parents and community
(2) Student Growth Measures
-- Value-Added-- Approved Vendor Assessments-- LEA Measures
![Page 6: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/6.jpg)
Student Growth Measures in OPES
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)
(A) Value-Added-- School-level Value-Added
(B) Approved Vendor Assessments-- School-level Composite Measure-- School-level Aggregate of AVA scores
(C) LEA Measures-- District SLOs-- District Value-Added-- Aggregate of Teachers’ Value-Added Scores-- Student Achievement Trends-- Progress on Improvement Plans-- Student Course-Taking Trend (e.g., AP)
![Page 7: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/7.jpg)
OTES\OPES Final Rating Determination
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)
![Page 8: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/8.jpg)
OTES\OPES Data for 2012-2013• OTES – 26 LEAs = 23 PSDs + 1 JVSDs + 2 CSs
• OPES – 27 LEAs = 24 PSDs + 1 JVSD + 2 CSs
• After exclusions for LEAs piloting OTES\OPES we have – 24 LEAs ~ 2,001 Teacher records – 15 LEAs ~ 62 Principal records– These sub-sample sizes drop further once “Exempt” records are excluded
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)
Ineffective Developing Skilled Accomplished Total
13 (0.6%) 298 (12.8%) 1,580 (67.8%) 441 (18.9%) 2,332 (100%)
Ineffective Developing Skilled Accomplished Total
0 (0%) 22 (12.9%) 98 (57.3%) 51 (29.8%) 171 (100%)
![Page 9: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/9.jpg)
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)
OTES\OPES Final Summative Ratings
![Page 10: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/10.jpg)
OTES: Performance Rating by SGM Rating
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)
![Page 11: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/11.jpg)
OTES: Distribution of SGM Ratings Across Performance Standard Ratings
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)
![Page 12: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/12.jpg)
OTES: SGM Category by Rating
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)
![Page 13: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/13.jpg)
OTES: Value-Added Weight by Rating
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)
![Page 14: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/14.jpg)
OTES: SLO Weight by Ratings
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)
![Page 15: An Empirical Investigation of Ohio’s Educator Evaluation System (MWERA)](https://reader035.vdocuments.us/reader035/viewer/2022062704/55630fb7d8b42a4b1d8b5585/html5/thumbnails/15.jpg)
Initial Conclusions
• Value-Added fairly congruent with other evaluation measures• Weight placed on Value-Added seems to be of no consequence for final
summative rating• Our early results in line with NYC (http://bit.ly/16qYVYg) … possibly other
states as well.
• Limitations – Limited data at hand– Potentially biased set of LEAs studied – Value-Added has been well studied; More research is needed for Vendor Assessments &
SLOs– Questions of OTES\OPES reliability are only answerable with multiple waves of data
11/08/13MWERA Annual Meeting 2013 (Evanston, IL)