Download - Smarter Balanced Assessment Consortium
Smarter Balanced Assessment Consortium
Update
Great Prairie AEA November 13, 2012
Students will strive to meet the target provided for them
Grade 4 ITBS Math 2001 – 2011
Grade 4 Reading 2001 - 2011
Iowa Students’ Performance on Different Measures
4th Reading
4th Math 8th Reading
8th Math 11/12th Reading
11/12th Math
0
10
20
30
40
50
60
70
80
90
100
82 8276 78 78 78
33
43
33 3439
25
Iowa Tests NAEP
% P
rofi
cie
nt
I O W A D E P A R T M E N T O F E D U C A T I O N
Iowa and Four other States - NAEP
1992 1996 2000 2003 2005 2007 2009 2011240
250
260
270
280
290
300
310
Iowa
Massachusetts
North Carolina
Louisiana
Texas
I O W A D E P A R T M E N T O F E D U C A T I O N
Turn to Your NeighborWhat does this data tell you?
Are We Measuring What We Think We Are Measuring?
• Proficiency in Iowa is set at 41%ile on Iowa Assessments.
• Iowa assesses only reading comprehension and math problem solving.
• The Iowa Assessment is not fully aligned to the grade level expectations of the Iowa Core.
• What worked with grade span standards does not work with grade level standards.
• All the top performing states have set their expectations of proficiency higher than Iowa.
We need to measure what we expect students to learn, if we want to be competitive
What we are currently doing isn’t working.
We need a vision of a Cohesive Summative Assessment System that supports instruction and student learning
To begin…Iowa is a member of 3 consortia:
1. Smarter Balanced Assessment Consortium – 25 states
2. Dynamic Learning Maps (DLM) – 12 states
3. English Language Proficiency Assessment 21 (ELPA21) – 12 states
Kindergarten Readiness Aligned to Iowa Early Learning Standards by
2013
ELA Assessment Aligned to Iowa Core by 2014-15
Mathematics Assessment Aligned to Iowa Core by
2014-15
Alternate Assessment Aligned to the Iowa Core
by 2014-15
English Language Proficiency Assessment
Aligned to New ELP Standards & the Iowa
Core by 2015-16
Science Assessment Aligned to New Iowa Core
Science Standards by 2015-16
Social Studies Assessment Aligned to New Iowa Core Social Studies Standards
by 2016-17
Goal: Fully Operational by
2016-17
Iowa Assessment
System
Think About…Smarter Balanced Assessment Consortium offers a more
comprehensive assessment system closely aligned to the CCSS.
A National Consortium of States
• 25 states representing over 19 million K-12 students
• 21 governing states
• 4 advisory states
• Washington state is fiscal agent; WestEd is Project Management Partner
Positioning Assessment as a Strategy for Improving Learning
Instruction(Powerful Pedagogy – including Formative Assessment Practices)
Assessment(O f Higher Order Thinking & Reasoning)
Learning(Defined by the
Standards)
Balanced Assessment System
Summative
InterimFormative
Balanced Assessment System
Selected Response
Performance Tasks
Constructed Response
Balanced Assessment System Built on Seven Key Principles
1. An integrated system2. Evidence-based approach3. Teacher involvement4. State-led with transparent governance5. Focus: improving teaching and learning6. Actionable information – multiple
measures7. Established professional standards
Work group engagement of 90 state-level staff:
Each work group: • Led by co-chairs from governing
states• 6 or more members from advisory
or governing states• 1 liaison from the Executive
Committee • 1 WestEd partner
Work group responsibilities:
• Define scope and time line for work in its area
• Develop a work plan and resource requirements
• Determine and monitor the allocated budget
• Oversee Consortium work in its area, including identification and direction of vendors
Accessibility and Accommodations 1
Formative Assessment Practices and Professional Learning
2
Item Development3
Performance Tasks4
Reporting 5
Technology Approach 6
Test Administration 7
Test Design 8
Transition to Common Core State Standards
9
Validation and Psychometrics10
Consortium Work Groups
ELA and MathHow will these new tests be different than what
we are currently using?
Grades 3-8 + High SchoolSummative & Interim
On-lineComputer Adapted + Performance Tasks
English Language Arts + Mathematics
Multiple Formats– Selected response– Short constructed
response– Extended response– Performance tasks
Multiple Types– Traditional – Technology enhanced
(e.g. drag and drop, building models, etc.)
– Performance task w/collaboration + independent
– Independent performance task
“Students can demonstrate progress toward college and career readiness in English Language arts and literacy.”
“Students can demonstrate college and career readiness in English language arts and literacy.”
“Students can read closely and analytically to comprehend a range of increasingly complex literary and informational texts.”
“Students can produce effective and well-grounded writing for a range of purposes and audiences.”
“Students can employ effective speaking and listening skills for a range of purposes and audiences.”
“Students can engage in research and inquiry to investigate topics, and to analyze, integrate, and present information.”
Overall Claim for Grades 3-8
Overall Claim for Grade 11
Claim #1 - Reading
Claim #2 - Writing
Claim #3 - Speaking and Listening
Claim #4 - Research/Inquiry
Claims for the ELA/Literacy Summative & Interim Assessments
“Students can demonstrate progress toward college and career readiness in mathematics.”
“Students can demonstrate college and career readiness in mathematics.”
“Students can explain and apply mathematical concepts and interpret and carry out mathematical procedures with precision and fluency.”
“Students can clearly and precisely construct viable arguments to support their own reasoning and to critique the reasoning of others.”
Overall Claim for Grades 3-8
Overall Claim for Grade 11
Claim #1 - Concepts & Procedures
Claim #2 - Problem Solving Modeling and Data Analysis
Reasoning
Claim #3 - Communicating
Claims for the Mathematics Summative & Interim Assessments
“Students can solve a range of complex well-posed problems in pure and applied mathematics, making productive use of knowledge and problem solving strategies.” “Students can analyze complex, real-world scenarios and can construct and use mathematical models to interpret and solve problems.”
Smarter Balanced Includes Formative Assessment to Support Instruction
Formative assessment is a process used by teachers and students as part of instruction. It provides feedback to adjust ongoing teaching and learning to improve students’ achievement of core content (Adapted from Council of Chief State School Officers, 2010).
FEEDBACK LOOP
Produced by AEA 267
Smarter Balanced Assessment Consortium’s Formative Digital Library
• The Digital Library is designed as an online, one-stop site with professional learning resources and collaboration opportunities for educators, parents, and students to learn more about balanced assessment systems, in particular formative assessment practices.
• Focus is to provide resources for educators, parents, and students that support student learning.
Formative Practices in the Digital Library – capacity building
• Formative tools that teachers can use throughout the year to better understand where students are in their learning of the Iowa Core and determine any misconceptions, allowing for quick adjustments to instruction as well as differentiated instruction.
Digital Library Resources
• Exemplar Instructional Modules w/FA • Inventory of Current Resources • Professional Learning on Assessment Literacy • Professional Learning on Smarter Balanced
Score Reports & Educator Resources • Professional Learning on the Digital Library
Resources • Educator-Submitted Supplemental Resources• Formative Assessment Training for State
Leadership Teams• Collaborative Professional Learning on
Formative Assessment• Glossary of terms
State Implementation TimelineDeveloped with Educators and Experts
2011-2012 School Year —
• Early 2012: Assessment claims for ELA/literacy and mathematics approved by Governing States
• April 2012: Item/task specifications and review guidelines published– http://www.smarterbalanced.org/itemspecs
• June 2012: Training modules available for item writers/reviewers– http://www.smarterbalanced.org/smarter-balanced-assessments/item-writing-and-re
view
• Summer 2012: Educators from Governing States began writing items and tasks; cognitive labs / small scale trials begin
State Implementation Timeline Developed with Educators and Experts
2012-2013 School Year —• September 2012: Sample items reviewed by Smarter Balanced staff and
advisors, Student Achievement Partners• Fall 2012: Achievement Level Descriptors development process begins• October 2012: Sample items and tasks available• Winter/Spring 2013 —Begin developing Digital Library & PD• February / March 2013: Pilot Test of first 10,000 items and performance
tasks• Spring 2013: Technology readiness tool available in BEDS2013-14 School Year• Fall 2013 — Achievement Level Descriptors development process begins• Summer 2013 — Assessment Literacy PD available and first set of
Exemplary Modules• Spring 2014 —Field testing of summative and interim assessments2014-15 School Year —Implementation of assessment system and final launch
of digital library
Formative Assessment Practices and Professional Learning – educator
involvementNational Advisory Panel (NAP)
•11-20 experts•Begins December 2012•Provides policies and criteria for resources
State Leadership Team (SLT)•5- 8 members•Recruiting begins November 2012•Provides training for State Network of Educators
State Network of Educators (SNE)•70 to 100 members•Representation from LEAs, AEAs, content leaders,
ELL, IHE•Begin recruiting in January 2013•Provides reviews,
Begins December 2012
National
Advisory Panel
•CONTRACTOR will begin recruiting December 18, 2012
•11 to 20 experts on formative assessment practices, adult on-line professional learning, and quality instruction incorporating universal design for a range of diverse learners
•develop and recommend policies to establish quality criteria to be applied to all resources recommended for the Digital Library
•The policies should include, but not be limited to the following contents:•Quality indicators of formative assessment
processes and tools•Quality indicators of professional learning•Quality indicators of effective instruction•Quality indicators of the effective use of evidence
Begins November 2012
State Leadership Team (SLT)
•State will begin recruiting November 2012 through December 18, 2012
•5 to 8 education professionals + State Lead•attend face-to-face or online meeting with
National Advisory Panel to provide feedback on proposed policies
•build the awareness and capacity of state-wide efforts to disseminate Smarter Balanced resources for educators through the Digital Library
•coordinate the process of selecting members for the State Network of Educators (SNE) in their states, and may serve as an SNE member
•attend regional meetings to learn to train members of the SNE to deliver training
•provides online training to SNE•provides leadership to the content-level and
grade-level groups represented in the SNE•developing plan to maintain and continuously
improve leadership, facilitation, and governance structures post-2014
State Network
of Educators
(SNE)
•CONTRACTOR will begin recruiting January 18, 2012•approximately 50 to 150 members per state and
2700+ across all states (approximately 77 - 90 members in Iowa)
•approximately $1500 stipend•all work completed by September 2014•participate in the review and feedback cycles for
development of the quality criteria policies, the Digital Library application, Smarter Balanced–developed resources, the inventory of currently available resources, and online training provided by the SLT
•identify and recommend additional resources for the Digital Library using their content and grade-level expertise.
•attend online trainings about the resources in the Digital library
•disseminate the training about resources in the Digital Library throughout existing state professional learning networks such as regional educational service centers or county offices, etc. (Area Education Agencies in Iowa and content leadership networks)Begins January 2013
Smarter BalancedSample Items and Performance Tasks
How will these new tests be different that what we currently are using?
Purpose of Sample Items and Performance Tasks
• Demonstrate rigor and complexity of ELA/literacy and mathematics questions
• Showcase variety of item types:• Selected response• Constructed response• Technology enhanced• Performance tasks
• Help teachers to begin planning for the shifts in instruction
Sample Items and Tasks http://www.smarterbalanced.org/sample-items-and-performance-tasks/
Think About….Will this assessment program meet the needs of our state?
What are we doing differently?
Exploring the Sample Items
Sample Items and Tasks http://www.smarterbalanced.org/sample-items-and-performance-tasks/
.
Scroll Down to….
Accessing the Sample Items and Tasks
The sample items and performance tasks are compatible with desktop and laptop computers with the following Internet browsers:
• Firefox 3.6 or newer
• Internet Explorer 8 or newer
• Chrome 18 or newer
• Safari 4.1 or newer
In addition, Android and iPad tablets with 9.5 inch screens (10 inch class) or larger are supported with the following Internet browsers:
• Chrome 18 or newer (Android)
• Safari 4.1 or newer (iPad)
Explore sample items and performance tasks:• English language arts/literacy• Mathematics• Frequently asked questions (PDF)
Sample Items and Tasks Navigation
View mathematics or ELA/literacy items
Advance to next item, or go back to previous
Sample Items and Tasks Navigation
Content Claim
Grade band
Sample Items and Tasks Navigation
Filter by item type, themes
Item Metadata
About this item
Exploring the Sample Items
Selected response and technology enhanced items are machine scorable
Feedback and Support Starting Oct. 9
Online feedback and phone support available
Accessibility and Accommodations
• Sample items do not include accessibility and accommodations features
• Full range of accessibility tools and accommodations options under development guided by:– Magda Chia, Ph.D., Director of Support for Under-Represented
Students– Accessibility and Accommodations Work Group– Students with Disabilities Advisory Committee
• Chair: Martha Thurlow (NCEO)
– English Language Learners Advisory Committee– Accessibility & Accommodations Framework
• Learn more online:– http://www.smarterbalanced.org/parents-students/support-for-under-represented-stu
dents/
Let’s Explore….
Choose at least one ELA and one math item to preview.
• What supports will be needed for students to engage with the technology enhanced items?
• How can we best prepare students to be successful with writing tasks in ELA or the communication items in mathematics?
• How can we best prepare students to be successful with performance tasks?
• What other issues do we need to address?• What questions do you still have?
CCSSO Webinar for Teachers on November 9 from 1:00 to 2:00 PM (CST)
2012 National Teacher of the Year to Speak about What Teachers Can Learn from the New PARCC and Smarter Balanced Sample Assessment
Items
CCSSO will be hosting a webinar with 2012 National Teacher of the Year Rebecca Mieliwocki on the recently released Partnership for Readiness for College and Career (PARCC) and Smarter Balanced sample assessment items in English language arts.
The webinar will be held on Friday, November 9 from 2-3 p.m. ET #-( 1-2PM CST).
To register, please visit https://ccsso.webex.com/ccsso/onstage/g.php?t=a&d=719177081. An analogous webinar focused on mathematics will also occur at a later date.
Scott Norton, Host
QuestionsContact: Colleen Anderson
Iowa Department of [email protected] DeeterIowa Department of [email protected]
QuestionsContact: Colleen Anderson
Iowa Department of [email protected] DeeterIowa Department of [email protected]
Grade 8 Mathematics 2001 - 2011
Grade 8 Reading 2001 - 2011
Grade 11 Math 2001 - 2011
Grade 11 Reading 2001 - 2011