test development center, june 2009 1 next-generation sunshine state standards : assessments and...

Test Development Center, June 2009 1

Next-Generation Sunshine State Standards : Assessments and Interpretive Products

June 1, 2009CLAS PresentationRenn Edenfield, FCAT Writing CoordinatorLyla Springfield, FCAT Reading CoordinatorVince Verges, Executive Director, Test Development CenterFlorida Department of Education

1


Topics

Staff Change End of Course Assessments SB 1908 Impact Reading Updates Writing Updates Interpretive Products Other Assessment Information

Questions


New Executive Director of National Assessment Governing Board (NAGB) Dr. Cornelia Orr, Assistant Deputy

Commissioner of Accountability, Research and Measurement, will be leaving the Department in mid-July to assume her new responsibilities

A search will be underway shortly for a replacement


End-of-Course (EOC) Assessments

Algebra 1 – Field test in May 2010, computer based only

Biology – Field test in May 2011, computer based only

American History - Field test in May 2012, computer based only

Currently, no plans for ELA EOCs

4


Revised Language Arts Standards: Impact on FCAT Reading

Assessment of 2007 standards was planned for FCAT Reading in 2011, but an interim solution will be used that is still to be decided, based on final 2009 standards

Draft Reading Test Item Specifications & 2010 field testing

Retakes remain the same, no PTs; FCAT Retakes given through a time yet to be determined


Revised Language Arts Standards: Impact on FCAT Reading

Planned Content Advisory meeting for Fall 2009 to gather educator input and recommendations on future reading assessments based on 2009 standards

Further timelines to be determined later


FCAT Reading - What is being tested and when? Last FCAT Reading Test – March

9-19, 2010 Field Test new benchmarks - 2010 No performance tasks at grades

4,8,10 2011 and beyond No summer retakes for Reading or

Mathematics


New Reading Test Item Specifications

Appendix B was released last Fall for Reading and Mathematics, 9/30/08

Spring 2009 release for Next-Generation Assessments Reading and Math Test Item Specifications

New Specifications document can be found at:http://fcat.fldoe.org/fcatis01.asp Remember: Impact on future tests is still TBD.

http://fcat.fldoe.org/fcatis01.asp

http://fcat.fldoe.org/fcatis01.asp


SB 1908 and Writing

“Beginning with the 2012-2013 school year, the comprehensive

assessments of writing shall be composed of a combination of

selected-response test items, short-response performance tasks,

and extended-response performance tasks, which shall measure a

student's content knowledge of writing, including, but notlimited to, paragraph and sentence structure, sentenceconstruction, grammar and usage, punctuation,

capitalization,spelling, parts of speech, verb tense, irregular verbs,

subjectverb agreement, and noun-pronoun agreement. “


SB 1908 and Writing

September Content Advisory to gather educator input and recommendations on future writing assessments based on 2009 standards


New Writing Test Timeline

December 2011 - Field Test Grade 4 New Writing Test , paper

based Spring 2012 Field test

Grades 7, 11 New Writing Test, computer based, not during regular Grade 8 and 10 tests

*************************************** Spring 2013 New Writing Test

Grades 4, 7, 11


FAQs about FCATWhat are the 2009-10 dates for FCAT Writing?

No December 2009 Field Test

Census Test– February 9-11, 2010

21


Are certain scorers assigned to each school or district?

Short answer: NO responses are distributed

randomly among all scorers each year

each school's responses are seen by a large number of scorers

22

Test Development Center, June 2009

23

Grade 4 NarrativePercentage of students earning

score point 3 and above and score point 4 and above

0102030405060

708090

100

2001 2002 2003 2004 2005 2006 2007 2008 2009

3 and above

4 and above

Per

cent

age

of s

tude

nts


24

Grade 4 Expository Percentage of students earning

Score point 3 and above and Score point 4 and above

010

2030

4050

6070

8090

100

2001 2002 2003 2004 2005 2006 2007 2008 2009

3 and above

4 and above

Per

cent

age

of s

tude

nts


25

Grade 8 Persuasive Percentage of students earning


0

10

20

30

40

50

60

70

80

90

100

2001 2002 2003 2004 2005 2006 2007 2008 2009

3 and above

4 and above

Per

cent

age

of s

tude

nts


26



010

20

30

4050

60

70

8090

100

2001 2002 2003 2004 2005 2006 2007 2008 2009

3 and above

4 and above

Per

cent

age

of s

tude

nts

27



0

10

20

3040

50

60

70

80

90

100

2001 2002 2003 2004 2005 2006 2007 2008 2009

3 and above

4 and above

(Note: No expository prompt given in 2008)

Per

cent

age

of s

tude

nts


28

Grade 10 PersuasivePercentage of students earning


0

10

20

30

40

5060

70

80

90

100

2001 2002 2003 2004 2005 2006 2007 2008 2009

3 and above

4 and above

Per

cent

age

of s

tude

nts


Writing Lessons Learned…

FCAT Writing Lessons Learned: 2001-2008 Data Analyses and Instructional Implications

Scheduled for delivery to districts in Spring 2010

PDF file posted To FDOE website after ADA compliance requirements - districts will be notified when it is available


All FCAT Subjects: Handscoring Quality Controls Rangefinder Meetings with Florida

Educators scoring student responses that are then used as training materials for FCAT scorers at handscoring

FCAT scorers are trained, monitored, and supervised throughout scoring


Handscoring Quality Controls

Education – minimum of a bachelor’s degree

Intensive training monitored by FDOE

Must qualify to score – demonstrate accuracy and consistency in scoring

Monitored throughout scoring by FDOE


Handscoring Quality Controls

20% of Reading and Mathematics performance task responses at all grades will receive a score from a 2nd reader

20% of responses to Writing prompts at grades 4 and 8 will receive a score from a 2nd reader

100% of responses to Writing prompts at grade 10 will receive a score from a 2nd reader


Distributed Scoring

Utilizes the same scorer requirements and controls

Will only be used with short-response in Reading and Mathematics in 2010 only

Extended responses will be scored at a specific regional site

Will not be used at all in Writing

33


2009 FCAT Content Focus Report Now available on the DOE website Has the benchmarks and content focus

for each item that counted towards student scores on the 2009 FCAT

Has total points for each reporting cluster/category

Identifies the benchmarks that had performance tasks

Reading and Mathematics have old to new benchmarks crosswalks


Sample Test Materials

Anticipated delivery date of January 2010 for Reading,

Mathematics, and Science (by legislative request)


FCAT Preparation Activities

Requires school districts to prohibit each public school from suspending a regular program of curricula in order to administer practice test or engage in other test-preparation activities for a statewide assessment (i.e., FCAT or end-of-course assessment).


Preparation continued…

to the extent determined necessary in State Board of Education rule, distribute and administer sample practice tests and answer keys published by FDOE or engage in other test-preparation activities.


“Florida Recycles” logo and statement will appear on non-secure FCAT materials.

Support the effort in your district!

DOE is going green!

FCAT contractors already use eco-friendly production methods. DOE is now actively promoting

recycling.

39

Region • Panhandle: 22%• East Central: 23%• Northeast: 17%• South: 20%• West Central: 17%

County Type• Rural: 19%• Urban: 36%• Suburban: 43%• University/Other 2%

County Size • Small: 22%• Medium: 40%• Large: 35%• University/Other: 3%

Ethnicity• Asian: 1% • African Am: 20%• Caucasian: 67%• Hispanic: 7%• Other: 5%

Gender• Female: 79% • Male: 21%

One Year of FCAT Participants2007 – 2008

40

One Year of FCAT Participants

Writing+ - 163 Members • Content Advisory• Educator Visits to Handscoring• Prompt Review• Item Content Review• Rangefinder

Science - 127 Members• Content Advisory• Educator Visits to Handscoring• Expert Review• Item Content Review• Lessons Learned• Rangefinder• Rangefinder Review• Gridded Adjudication

Reading - 140 Members• Content Advisory • Educator Visits to Handscoring• Item Content Review• Passage Review• Rangefinder• Rangefinder Review

Mathematics -144 Members• Content Advisory• Gridded Adjudication• Educator Visits to Handscoring• Item Content Review• Rangefinder• Rangefinder Review

Sensitivity - 31 Members• Reading• Mathematics • Science• Writing+

Bias - 45 Members•Reading & Mathematics• Science • Writing+

2007-2008

677 participants, 38 weeks of meetings, and 76 different meetings

Advisory - 27 Members• Technical Advisory• FCAT Reports


FCAT Resources On the Web

• website: fcat.fldoe.org

• FDOE website: fldoe.org


Available Resources 2009 FCAT Writing Anchor Sets

posted to web, on or before August 2009

2008 Florida Reads! Writes! Solves! Inquires! CD in Districts

Test Development Center Sharepoint Site:http://sharepoint.leon.k12.fl.us/tdc/external/default.aspx


FCAT PublicationsContact Information

Trish Lyons Publications Coordinator

(850) 922-2584 ext. 227 SunCom 292-2584 ext. 227 [email protected]


Contact Information Lyla Springfield, FCAT Reading Coordinator:

[email protected] Steve Ash, FCAT Mathematics Coordinator:

[email protected] Renn Edenfield, FCAT Writing Coordinator:

[email protected] Linda Oravetz, FCAT Science Coordinator:

[email protected] Vince Verges, Executive Director Test

Development Center: [email protected]

test development center, june 2009 1 next-generation sunshine state standards : assessments and...

Documents

fcat reading test

biology field test

response test items

mathematics slide

field test new benchmarks

later slide

replacement slide

american history field