Download - Race to the top assessments
1
RACE TO THE TOP ASSESSMENTS
Sally SandersScience Content Specialist
October 24, 2012
Florida Association of Science Supervisors
Update from the Office of
2
Race to the Top Goals Double the percentage of incoming high
school freshmen who ultimately graduate from high school, go on to college, and achieve at least a year’s worth of college credit;
Cut the achievement gap in half in 2015; Increase the percentage of students
scoring at or above proficient on NAEP by 2015, to or beyond the performance levels of the highest-performing states.
Florida’s RTTT Application
Three projects assigned specifically to the Office of RTTT Assessments: Florida Interim Assessment Item Bank
and Test Platform District-developed Assessments for
Hard-to-Measure Content Areas Contract for FL participation in
international benchmarking studies (TIMSS, PIRLS, PISA)
3
4
District Developed AssessmentsContent Awarded DistrictsPhysical and Health Education: K-8
Miami-Dade County
Physical and Health Education: 9-12
Hillsborough County
Performing Arts: K-12 Polk CountyVisual Arts: K-12 Miami-Dade CountyCareer and Technical Education
Hillsborough County
World Languages Duval County
Status Update: Hard to Measure Content Areas
Competitive Award for seven projects issued in August 2011
Main deliverable in Year 1 (2011-12): Item Specifications
Main deliverable in Year 2 (2012-13): Item Development
Main deliverable in Year 3 (2013-14): Field Testing
5
6
Timeline – District-Developed Student Assessments Project
2011-12 2012-13 2013-14
Fall Spring Summer Fall Spring Summer Fall SpringMonitoring, Communication and Risk Management plans completedItem development planItem review planItem writer training materials
Item specifications for PE/ Health, Visual Arts, Performing Arts, CTE, World LanguagesBatch 1 items for reviewBatch 2 items for reviewYear 1 items uploaded to test platform for pilot testing
Item DevelopmentFace-to-Face Project Meeting
Item developmentBegin test design specifications
Batch 3 items for reviewBatch 4 items for reviewReview of items for bias and contentYear 2 items uploaded to test platform for pilot testingTest design specifications complete
Preparation for Field-Testing.
Batch 5 items for review
State-wide field testTrain performance scorersAnalyze dataData review for bias and contentCompile final item pool
7
Status Update: TIMSS, PIRLS, PISA
TIMMS (Trends in International Mathematics and Science Study) Test given in Spring 2011 in Grades 4 and 8 Results available in Spring 2013
PIRLS (Progress in International Reading Literacy Study) Test given in Spring 2011 in Grade 4 Results available in Spring 2013
PISA (Program for International Student Assessment) Test will be given in Fall 2012 to 15-year-old students Results available in Spring 2014
8
Item Bank and Test Platform
Statewide technology-based system Bank of standards-based items/tasks
In development Test builder tool to construct valid and
reliable assessments Diagnostic, interim, summative
Computer or paper-based functionality
9
Item Bank and Test Platform
Online tutorials for use of the item bank
item writing
item reviewing
assessment development
10
Timeline - Interim Assessment Item Bank and Test Platform Project
2011-12 2012-13 2013-14Fall Spring Summer Fall Spring Summer Fall Spring
Bid protest to ITN
Intent to award published
Contract awarded to Pearson
Test item development plan & blueprint of the content standards
Plan for Item review is approved
Communication plan of PD modules
Recruitment of Florida Educators for Item Reviewers and Writers
Item specifications Math, ELA,SS, Sci, Spanish
Approved item development plan for yr2
All year 1 items in bank
Y1 batch 1&2 completed
Meetings for item reviewers and review
Sustainability planMeetings for item
reviewers and review have been conducted
Phase 1 of item bank is operational
Develop communication to stakeholders
Online system of tutorials-approved and available
Y1 batch 3,4 & 5 completed
All meetings for item reviewers and review have been conducted
Y 1 submitted and approved
Functionality test
Phase 2 is operational
Year 2 batch 1completed
Approved item development plan for Y2
Deliver approved communication plan
Y2 batch 2,3 & 4completed
Interim assessment for Math (FAIM)
Item Tryouts completed
Online training for educators to write items
Y2 batch 5 completed
All meetings for item reviewers and review have been conducted
All items for Y3 submitted and approved
Phases 3-6 are operational
Item Bank and Test Platform fully functional.
11
CCSS Connection Common Core State Standards
http://www.corestandards.org/ Common Core Tools
http://commoncoretools.me/author/wgmccallum/
The Teaching Channel: Inspired Teaching, Inspiring Classrooms https://www.teachingchannel.org
Education Northwest http://educationnorthwest.org/resource/1756
CPALMS http://cpalms.org
12
PARCCConnection Partnership for Assessment of Readiness
for College and Careers http://parcconline.org/ Sample Item and Task Prototypes Model Content Frameworks
PARCC assessments aligned to the CCSS
Vince Verges, PARCC Project Director Serves as K-12 Lead for PARCC in Florida
13
Classroom Connection Interim Assessments
Given at regular intervals throughout the school year
Designed to evaluate students’ knowledge and skills relative to a specific set of academic standards
Data can be aggregated to inform instruction
14
Tier 1
• Differentiated Accountability & other state level programs
Tier 2
• District level access• This collection will house
the majority of items.
Tier 3
• School level access
Tier 4
• Classroom teacher access
Tier 5
• Public access• Sample items. Collection
will grow over time.
•Tiers 1-4 will be password accessible to a limited group of people.•Greatest security is employed for Tier 1 items, with wider access available at lower levels.•As items are no longer used at an upper level, they will move to become available at the next level down. •By end of Year 2, the IBTP will house approximately 60,000 items.
IBTP Item Distribution
15
Item Specifications Purpose: Provide guidance to item
writers and reviewers for the development of high-quality standards-based (NGSSS and CCSS) assessment items
Status: Item specifications are in final phase of development/approval; item writers are using draft version of specs
16
Item Types Selected Response Short Response Gridded Response Constructed Response Extended Response Essay Response Performance Tasks
24
District Involvement Florida educators are involved in writing and
reviewing items for the Interim Assessment Item Bank; writers and reviewers are compensated
Next slide shows district representation as of October 2012 Column 1: Total item writers/district for all 5 content
areas (Science, Mathematics, ELA, Social Studies, and Spanish)
Column 2: Total item writers/district for Science Column 3: Total item reviewers/district for all 5
content areas Column 4: Total item reviewers/district for Science
25
Item Writers
Item Reviewers
Item Writers
Item Reviewers
Item Writers
Item Reviewers
All Science All Science All Science All Science All Science All Science
Alachua 2 0 1 0 Gulf 0 0 0 0 Okeechobee 0 0 1 0Baker 1 0 0 0 Hamilton 0 0 0 0 Orange 3 0 2 0Bay 8 2 4 1 Hardee 0 0 0 0 Osceola 3 1 2 0Bradford 0 0 0 0 Hendry 1 0 0 0 Palm Beach 11 1 3 1Brevard 3 1 4 0 Hernando 4 0 1 0 Pasco 7 2 2 0Broward 54 7 16 2 Highlands 0 0 0 0 Pinellas 6 1 1 0Calhoun 0 0 1 0 Hillsborough 17 0 3 1 Polk 4 1 1 0Charlotte 2 0 1 0 Holmes 0 0 0 0 Putnam 0 0 0 0Citrus 4 1 1 0 Indian River 0 0 0 0 St. Johns 15 6 4 2Clay 3 0 1 0 Jackson 1 0 1 0 St. Lucie 13 6 3 0Collier 8 0 2 0 Jefferson 0 0 0 0 Santa Rosa 1 0 0 0Columbia 0 0 0 0 Lake 28 9 3 0 Sarasota 0 0 0 0Dade 23 4 8 6 Lee 10 2 3 1 Seminole 6 0 1 0DeSoto 2 0 1 0 Leon 5 0 1 1 Sumter 0 0 1 0Dixie 0 0 0 0 Levy 2 0 0 0 Suwannee 0 0 0 0Duval 11 5 2 1 Liberty 1 0 0 0 Taylor 0 0 1 0Escambia 11 2 2 0 Madison 0 0 0 0 Union 0 0 0 0Flagler 1 0 0 0 Manatee 5 0 2 0 Volusia 9 2 8 2Franklin 0 0 0 0 Marion 10 1 2 0 Wakulla 4 1 1 0Gadsden 0 0 1 0 Martin 1 0 0 0 Walton 0 0 0 0Gilchrist 0 0 0 0 Monroe 1 0 0 0 Washington 0 0 0 0
Glades 1 0 0 0 Nassau 2 0 0 0 Totals 309 55 93 18
Glades 1 0 0 0 Okaloosa 4 0 1 0 as of 10/4/12
26
How can your district be involved?
Functionality Testing Phase I – in progress
Nominate Item Writers Nominate Item Reviewers Item Tryouts (field testing)
27
How can educators be involved? Serve as item writers or reviewers Test the functionality of the test platform
Send contact information to [email protected]
Name District E-mail address Teaching assignment
Office of RTTT AssessmentsDirector: [email protected] Developed Assessments for HtM
Project Manager: [email protected] Project Manager: [email protected] Content Specialists: English/Language Arts:
[email protected] Mathematics: [email protected] Science: [email protected] Social Studies: [email protected] Spanish: [email protected]
28
Florida’s Common Core State Standards (CCSS) Implementation Plan
2011-2012Full Implementation Grade KBegin Implementation of Literacy Standards in ALL Content Areas for Grades 6-12Begin Implementation of Rich and Complex Text and Informational Text for Grades K-12
2012-2013Full Implementation Grades K-1Full Implementation of Literacy Standards in ALL Content Areas for Grades 6-12Continue Implementation of Rich and Complex Text and Informational Text for Grades K-12
2013-2014Full Implementation Grades K-2Implementation of a Blended Curriculum (CCSS and Supplemental NGSSS Aligned to FCAT 2.0 and EOCs) for Grades 3-12Continue Implementation of Rich and Complex Text and Informational Text for Grades K-12
2014-2015Full Implementation Grades K-12PARCC Assessments Aligned to CCSS
30
Florida Statute – Passed as Part of Senate Bill 736 in Spring 2011
Section 1008.22 FS:(8) LOCAL ASSESSMENTS.—
(a) Measurement of the learning gains of students in all subjects and grade levels other than subjects and grade levels required for the state student achievement testing program is the responsibility of the school districts.(b) Beginning with the 2014-2015 school year, each school district shall administer for each course offered in the district a student assessment that measures mastery of the content, as described in the state-adopted course description, at the necessary level of rigor for the course. Such assessments may include: 1. Statewide assessments.2. Other standardized assessments, including nationally recognized standardized assessments.3. Industry certification examinations.4. District-developed or district-selected end-of-course assessments.(c) The Commissioner of Education shall identify methods to assist and support districts in the development and acquisition of assessments required under this subsection. Methods may include developing item banks, facilitating the sharing of developed tests among school districts, acquiring assessments from state and national curriculum-area organizations, and providing technical assistance in best professional practices of test development based upon state-adopted curriculum standards, administration, and security.
Section 1008.22, FS Student assessment program for public schools
SALLY SANDERSOFFICE OF RACE TO THE TOP
ASSESSMENTSSCIENCE SPECIALIST
[email protected] (850) 245-0760
31
Fall 2012
Thank you
Division of Accountability, Research, and Measurement Florida Department of Education