testing and accountability update july, 2010 dr. karen schafer office of testing and accountability

Testing and Accountability Update

July, 2010

Dr. Karen SchaferOffice of Testing and Accountability

2

What’s Up With School Grades?

• July 12: Letter from Hillsborough, Duval, Broward, Dade, Leon noting “significant anomalies” in FCAT data

– “substantial decreases in learning gains components”

– “losses are especially prominent in the lowest 25% reading gains, particularly at elementary level”

– “serious consequences for the School Grade and AYP designation” and DA decisions

– Requested review of data & delay of release of School Grades and AYP

3

What’s Up With School Grades?• DOE Response

• Request for more information from other districts• “confident in the accuracy and reliability of this

year’s FCAT results, as independently confirmed by The Buros Center for Testing”

• Has contracted with HumRRO and The National Center for the Improvement of Educational Assessment for audits of 2010 results and equating with previous years’ results

• Created website for transparency http://www.fldoe.org/schoolgrades.asp

FCAT

4

What’s Up With School Grades?• Bottom Line

• Don’t know when audits will be completed• Don’t know when School Grades/AYP will be

released

• “Proceed with the opening of schools to provide the best educational environment for students”

• Make good decisions and proceed without School Grades or AYP

• DA: Regional directors contacting superintendents to discuss.

• Hold requests for Score Inquiries until after audit

FCAT

5

Percent Of Students Making Learning Gains by Achievement Level (L731)

Grade 4

2009 Achievement Level - 2010Ach Lev

IncreasedAch Lev

DecreasedMade Learning

Gains

2YearsAch

Level 1 2 3 4 5 Total % Total % Total %READ 454 1 274 71 97 10 2 180 40 0 0 298 66 434 2 123 127 150 33 1 184 42 123 28 263 61 1597 3 101 209 848 400 39 439 27 310 19 1287 81 1899 4 3 35 442 1047 372 372 20 480 25 1419 75 520 5 0 0 13 179 328 0 0 192 37 328 63

MATH 293 1 189 74 29 1 0 104 35 0 0 214 73 466 2 96 222 137 10 1 148 32 96 21 264 57 1472 3 43 282 883 243 21 264 18 325 22 1147 78 1701 4 2 35 599 870 195 195 11 636 37 1065 63 966 5 0 3 47 413 503 0 0 463 48 503 52

6

Percent Of Students Making Learning Gains by Achievement Level

Grade 5

2009 Achievement Level - 2010Ach Lev

IncreasedAch Lev

DecreasedMade Learning

Gains

2YearsAch

Level 1 2 3 4 5 Total % Total % Total %READ 317 1 214 62 35 6 0 103 32 0 0 159 50 424 2 113 143 149 19 0 168 40 113 27 169 40 1703 3 100 306 938 342 17 359 21 406 24 1297 76 1791 4 6 28 505 1015 237 237 13 539 30 1252 70 639 5 0 0 25 274 340 0 0 299 47 340 53

MATH 350 1 253 84 11 2 0 97 28 0 0 225 64 572 2 153 314 96 9 0 105 18 153 27 334 58 1655 3 50 543 734 323 5 328 20 593 36 1062 64 1562 4 1 49 415 908 189 189 12 465 30 1097 70 734 5 0 1 20 299 414 0 0 320 44 414 56

7

Percent Of Students Making Learning Gains by Achievement Level

Grade 4 and 5 Learning Gain Changes from 2009 to 2010

2009 2010 2009 2010 09-10 changeGr 4 Gr 4 Gr 5 Gr 5 Gr 4 Gr 5

R L1 76 66 63 50 -10 -13R L2 78 61 47 40 -17 -7R L3 86 81 82 76 -5 -6R L4 78 75 71 70 -3 -1R L5 59 63 46 53 4 7

M L1 67 73 69 64 6 -5M L2 56 57 63 58 1 -5M L3 79 78 68 64 -1 -4M L4 67 63 75 70 -4 -5M L5 53 52 53 56 -1 3

ACCOUNTABILITY CHANGESSchool Grade and AYP

9

AYP Changes

• 2009-10: HS Graduation Rate criteria for AYP- Change from 1% improvement over prior year to 2%

• 2009-10: AYP Annual Proficiency Targets:• Reading: 72% (up from 65%)• Math: 74% (up from 68%)

• 2010-11: AYP Annual Proficiency Targets:• Reading: 79%• Math: 80%

Annual Proficiency Targets(AYP Percent-Proficient Targets)

Reading Target Mathematics Target

2001-02 31% 38%

2002-03 31% 38%

2003-04 31% 38%

2004-05 37% 44%

2005-06 44% 50%

2006-07 51% 56%

2007-08 58% 62%

2008-09 65% 68%

2009-10 72% 74%

2010-11 79% 80%2011-12 86% 86%

2012-13 93% 93%

2013-14 100% 100%

10

11

School Grade Changes•For 2009-10

• Writing Criteria: average of percent scoring 3.0 and above and percent scoring 4.0 and above

• Florida Alternate Assessment (FAA) results for students with disabilities will be included in the overall learning gains components for reading and math. (Not for Lowest 25%)

• Minimum cell size for writing and science performance measures is 10. Schools with enough students tested in reading and math to receive a grade but don’t have at least 10 eligible students tested in writing and/or science will receive the district average for those measures.

• High School Grades: 50% based on FCAT components, 50% on non-FCAT components

12

New (non-FCAT) Components for High School Grading (2009-10)

1. Graduation rate. [200 points]2. Graduation rate of at-risk students. [100 points]3. Accelerated curriculum participation (AP, IB, Dual

Enrollment, AICE, Industry Certification) [200 points]4. Accelerated curriculum performance [100 points]5. Postsecondary readiness of students as measured by the

SAT, ACT, or the CPT. [100 points, Math; 100 points, Reading]

6. Growth or decline in the data components of these measures from year to year.

- Additionally, to receive an “A”, a school must demonstrate that at-risk students in the school are making adequate progress.

13

School Grade Changes• 2010-11: Fall Retakes will be paper and pencil

based only

• 2010-11: Writing Criteria changes to percent scoring 4.0 and above

• IN DEVELOPMENT for 2010-11: Learning Gains - more points for students who move multiple levels and/or move to level 4 or 5

• IN DEVELOPMENT for 2011-12: Learning Gains for EOC exams

FCAT REIMBURSEMENTS• For personnel or material costs DIRECTLY related to the

delay of FCAT scores• Mailing (postage, copying, envelopes)• Scheduling• Curriculum decisions

• Only for personnel NOT employed over the summer –Contract and support employees

• Complete the form• Electronically submit to Karen Schafer• Courier signed hard copy of form w/ receipts to K Schafer• Verified forms sent to finance• Payroll reimbursement will run in August payrolls• Other costs will be added to school/department budget

when reimbursement received from DOE

Additional Costs Incurred Due to Delayed FCAT ResultsSchool/Department Name:School/Department Number:Contact Person: Phone: Positions and Salaries (add more rows if necessary)School Level Positions (Certificated)

Employee Name

Employee ID#

Pay Type Position Title

FCAT Related Job

AssignmentDates

Worked Hourly Rate

# of Additional

Hours

Amount ($) of Add'l Salary

Amount ($) of Add'l Benefits

Total ($) Add'l

Salary & Benefits

Sample Doe 10055555 BAAssistant Principal - 10M scheduling 7/6/10 35.00 8.00 280.00 53.14

333.14

C04CONTRACT PAYROLL

              0.00 0.00 0.00

                0.00 0.00 0.00                0.00 0.00 0.00

H04SUPPORT PAYROLL

              0.00 0.00 0.00

                0.00 0.00 0.00                0.00 0.00 0.00                0.00 0.00 0.00                0.00 0.00 0.00                0.00 0.00 0.00

Total Additional School/Department Level Costs 0.00 0.00 0.00 0.00Other Costs Comments Type     Cost

Materials and Supplies Postage/Shipping Printing/Copying Other (Please Describe Under Comments Section)

Total Other Costs 0.00Total All Additional Costs 0.00

Principal's Name Principal's Signature Date

DATES FOR TIME ENTRY ARE AS FOLLOW:C04 - 7/28 - NOON 8/6/10H04 - 8/4 - NOON 8/13/10

16

2010 LEGISLATION

SB 4HB 105

17

High School Graduation Requirements

Entering 9th Grade To Graduate2010 Algebra 1 and Geometry

+2011 Biology* and Algebra EOC

+2012 Biology EOC, Geometry EOC

and Algebra II+

2013 Chemistry*or Physics* and an equally rigorous science course

* Or successful completion of Integrated Science sequence

18

End of Course Exams• EOC exam counts as 30% of student’s “course grade” for each

first year 9th grade cohort required to take the exam – This year the Algebra 1 EOC will count as 30% of the student’s “course

grade”

• Each subsequent year student must pass EOC to earn course credit

• Students with disabilities for whom the IEP committee determines that an EOC cannot accurately measure the student’s ability must take the EOC, but may receive a waiver for the course grade and for course credit.

• EOC results will come as scale scores and achievement levels and will be used to calculate school grades.

19

End of Course Exams

EOC Exam Entering 9th Grade StatusAlgebra I 2010-11 Counts 30% of

course grade2011-12 Must pass for course

creditGeometry 2010-11 Field Test

2011-12 Counts 30% of course grade

2012-13 Must pass for course credit

20

End of Course Exams

EOC Exam Entering 9th Grade StatusBiology 2010-11 Field Test

2011-12 Counts 30% of course grade

2012-13 Must pass for course credit

US History 2011-12 Field Test2012-13 Counts 30% of

course grade

21

Additional End of Course Exams

EOC Exams Listed for DevelopmentEnglish II

Noted as “priority” to replace gr. 9 & 10 FCAT Reading and gr. 10 Writing

Algebra IIChemistry

PhysicsEarth/Space Science

World History

22

End of Course Exams

• CAP: Credit Acceleration Program• Students not enrolled in courses may take

EOC for course credit with a passing score

• Changes to HS FCAT Assessments • 2010-11: Gr. 9 FCAT Math eliminated• 2011-12 Gr. 10 FCAT Math eliminated (except

Retakes)• 2011-12: HS FCAT Science eliminated

• EOCs substituted as requirement for graduation and in the calculation of School Grades

23

Other Legislative Changes• Major Area of Interest elective requirement

eliminated

• Requirement that students take FCAT 3 times before applying concordant score eliminated

• Requirement that High Schools offer IB, AICE, or a combination of at least 4 courses in DE or AP (MESH) beginning in 2011-12

• Requirement for Middle Grades Civics for promotion and EOC in 2013-14

Graduation Requirements and EOCs by 9th Grade Cohorts

25

No gr. 9 FCAT Math No gr. 9/10 FCAT Math, gr. 11 Sci

CBT for gr. 5, 7, 10 Reading & gr. 6, 7 Math

Assessment Timeline

27

28

Do all the right parties know about what’s coming and when?

Are We Prepared?

29

Does instruction match the preparation needs of our students?

Are We Prepared?

30

Are We Prepared? This year’s 9th grade students must earn a

geometry credit to graduate. Those enrolled in Algebra I will take an EOC that will count as 30% of their course grade.

• Do 9th grade teachers, students, and parents know this?

• Have we reviewed the quality of instruction in our Geometry classrooms?

• Are Algebra I teachers using the course description the EOC was written to assess to guide their instruction?

31

Are We Prepared?

This year’s 8th grade students will be required to pass the Algebra I EOC and earn credit in Geometry and Biology which include EOCs as part of their grades to graduate. (Unless credit has already been earned when they get to 9th grade.)

• Do 8th grade teachers, parents and students know this? • What does 8th grade mathematics and science look like? • Are 8th grade mathematics and science teachers using

the course descriptions to guide instruction and assessing students throughout the year based on these course descriptions?

• Are teachers using the course descriptions that the EOCs are written to assess to guide their instruction?

• Do students’ grades reflect the amount of material in the course description learned?

32

Are We Prepared?

This year’s 7th grade students will be required to pass EOCs in Algebra I, Geometry, and Biology to graduate. They will also have to earn credit in Algebra II.

•Do 7th grade teachers, parents and students know this?

•Are teachers using the mathematics and science course descriptions to guide instruction and assessing regularly to assure students are learning the material?

•Do the students’ grades reflect the amount of material learned?

•Are teachers using the course descriptions that the EOCs are written to assess to guide their instruction?

33

Are We Prepared?

This year’s 5th and 6th grade students will be required to pass EOCs in Algebra I, Geometry, and Biology to graduate. They will also have to earn credit in Algebra II, Chemistry or Physics and an equally rigorous science course.

•Do 5th and 6th grade teachers, students, and parents know this? •Are teachers using the mathematics and science course descriptions to guide instruction and assessing regularly to assure students are learning the material? •Do the students’ grades reflect the amount of material learned?•Are teachers using the course descriptions that the EOCs are written to assess to guide their instruction?

34

Are We Prepared?

This year’s K-4th grade students will be required to pass EOCs in Civics, Algebra I, Geometry, and Biology to graduate. They will also have to earn credit in Algebra II, Chemistry or Physics and an equally rigorous science course.

2009 to 2010 Achievement Level Changes and Learning Gains from L731

35

36

37