smarter balanced assessments test coordinators training ... · test coordinators (tcs) will...
TRANSCRIPT
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Smarter Balanced Assessments
Test Coordinators Training School Year 2016-17
1
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Assessment and Accountability Branch Tom Saka - Director, Assessment and Accountability Branch
Assessment Section Brian Reiter – Administrator, Assessment Section Carol Anton – Test Development Specialist Paul Dumas – Test Development Specialist Bruce Hirotsu – Test Development Specialist Kua’anaa’i Lewis – Test Development Specialist Karen Tohinaka – Test Development Specialist Robert Hillier – NAEP Testing Specialist
American Institutes for Research Emily MacGillivray – AIR Project Manager
2
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Desired Outcomes & Training Objectives
Test Coordinators (TCs) will understand and be able to successfully fulfill the important role they have in test administration as key members of the School Assessment Team.
As a result of this training TCs will better understand: – the components of Smarter Balanced assessments. – the components of Hawaii’s online assessment system. – the processes, procedures, and polices associated with the
administration of Hawaii’s online assessments including the SB assessments.
– and be prepared to successfully carry out their responsibilities.
Our students will be fully prepared for the Smarter Balanced Assessments which will be appropriately administered such that our young people have a fair and reliable
opportunity to demonstrate their knowledge and skills.
3
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Notable Developments for SY 2016-17 • TIDE and ORS have a new look and feel. The functionality is still
there but some tasks have moved from one application to the other.
• Updated Interim Assessments including some new Interim Assessment Blocks
• Air Ways Reporting will give teachers more detailed information regarding student performance on the Interim Assessments including the ability to view student responses to items.
• A new Simplified Test Directions designated support and 100s Number Table accommodation.
• Assessment Section verification for non-embedded accommodations prior to administering a test.
• Increased need to monitor Participation Rates in TIDE, especially for “special groups” such as SPED, ELL, and Disadvantaged students
4
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
What are academic standards? • Standards are statements of what
students are expected to know and be able to do at specific grade levels. Clear, consistent and high expectations
for ALL students • Standards provide clear targets for
educators as they support students on the path to college and career readiness. A consistent guide for instruciton and
evaluation of student work for ALL teachers.
5
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Academic Standards
Curriculum: What is taught
Instruction: How it is taught
Assessment: How well
Interventions: What if they don’t get it
6
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Standards-Based Classrooms
• Curriculum, instruction and assessment explicitly aligned to the standards
• Teachers and students have a clear understanding of learning expectations and why the day’s learning is important/relevant
• Students produce evidence of learning Standards-based learning is a process, not an event.
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
What might you see…
• Student work aligned to the standards
• Written and oral feedback aligned to the standards
• Performance tasks aligned to the standards, including culminating performance tasks
• Data driven instructional decisions
• On-going, formal and informal assessment for learning
• Teaching and scoring rubrics aligned to the standards
• Flexible groups of students
• Differentiation of instruction
• Standards-based instructional bulletin boards
8
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Assessments • Standards-based education has
assessment as a key part of the movement the first part is to set new, higher standards to
be expected of EVERY student a criterion is set up for what EVERY student is
expected to know and a score is set compared to those benchmarks thus curriculum must be aligned with the new
standards students must then be assessed based on
what is expected of EVERY student gauges individual student progress
9
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Purpose of Statewide Assessments Communicate meaningful benchmarks to which the
Department, schools, teachers and students can aspire Provide direction for schools’ instructional efforts and for
students’ learning Provide accurate feedback on performance - including
insights on curriculum strengths and weaknesses for various levels of the system
Educators and students use feedback to improve learning
Motivate students to learn better, teachers to teach better and schools to be more educationally effective
Herman, Joan L. (1997). Large-Scale Assessment in Support of School Reform: Lessons in the Search for Alternative Measures, CRESST, cresst.org/wp-content/uploads/TECH446.pdf
10
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Policy Framework for Statewide Assessments
• Federal Every Student Succeeds Act: Annual student assessment of states’ standards in ELA/Literacy and Mathematics - grades 3-8 and once in high school Science – once each grade span English language proficiency for English Learners
• Hawaii Revised Statutes 302A – 1004 (6): Annual statewide assessment program that provides….data on school, school complex and system performance…with performance indicators in areas relating to student achievement…(including) student performance relative to statewide content and performance standards
• BOE Policy 102-6: The department shall establish a statewide assessment program that provides annual data on student, school, and system performance, including public charter schools, at selected benchmark grade levels, showing student performance, relative to the applicable statewide performance standards and relative to nationally representative norms, as applicable.
11
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Making the Most of Summative Assessment Scores in an Instructional Planning Cycle
Teaching & learning
Assessment
Analysis of results
Feedback to learners & teaching process
Responding to feedback
Summative Assessment
12
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Hawai’i Statewide Assessment Program (HSAP)
The Hawai’i Statewide Assessment Program (HSAP) is a statewide standardized testing program aligned to the Hawai’i content standards (Hawai’i Common Core or HCPS III), which define the knowledge and skills required for students to succeed beyond high school. The HSAP is designed to:
help schools and districts determine whether students are making progress on meeting standards; and
help the state learn how schools, complexes and complex areas are ensuring that children are meeting the standards.
PURPOSE:
alohahsap.org
13
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Hawai’i Statewide Assessment Program (HSAP)
What do the results of the HSAP mean, and how are they used?
HSAP results summarize student abilities as they relate to the Hawai’i content standards. The results are used: in accountability measures such as STRIVE HI, to identify professional development needs, and
as one of many tools a teacher may use to help identify a
student’s strengths and weaknesses.
14
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Relationship to Standards Based Education
• Schools, teachers and students need achievement targets to which they can aspire; statewide assessments provide those targets for grade level proficiency of the content standards
• Schools and teachers need evidence of student achievement of the content standards to base decisions about the effectiveness of instructional efforts; statewide assessments provide this evidence
• The Department, schools and teachers need accurate feedback on performance in order to analyze curriculum strengths and weaknesses; statewide assessments are of the highest technical quality and provide accurate information on performance
15
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Relationship to Standards Based Education (cont.)
• Educators and students use statewide assessment results as feedback to gauge the extent to which the content standards have been mastered
• The results of the statewide assessments serve to motivate students to learn better, teachers to teach better and schools to be more educationally effective teaching to the content standards
16
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Hawaii Smarter Balanced Assessment Basics
17
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Smarter Balanced Assessments • Measure students’ progress toward academic
goals of Hawaii Common Core in ELA/Literacy and Mathematics based on 21st century expectations: – Critical thinking – Problem solving – Analytical writing
• Created by educators – over 3000 (including Hawaii educators) participated in the development and standard-setting
• Benchmarked internationally • Given in 17 states and territories in 2016 • Recognized by nearly 200 colleges or universities for
placement into college-level courses • Administered first in 2015
http://www.smarterbalanced.org/
18
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Test Characteristics
ELA/Literacy Mathematics
Grades 3-8 and high school Grades 3-8 and high school
• Computer Adaptive Test – approx. 90 min • Performance Task – approx. 90 min
• Computer Adaptive Test – approx. 90 min • Performance Task – approx. 90 minutes
Test Questions Types • Multiple choice • Constructed Response
Test Questions Types • Multiple choice • Constructed Response
Claims: 1. Reading 2. Listening 3. Writing 4. Research/Inquiry
HSAs only assessed Reading (90 min); SB assesses additional 3 content areas
Claims: 1. Concepts and Procedures 2. Problem Solving* 3. Communicating Reasoning 4. Modeling and Data Analysis*
Similar to ELA/Literacy, the SB Mathematics assess significantly more content standards, i.e., the HCC
The Smarter Balanced Assessments assess the full breadth and depth of the Hawaii Common Core standards in ELA/Literacy (except speaking) and
Mathematics.
*combined for reporting purposes
19
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Smarted Balanced Assessment System of the Hawai‘i Common Core Standards
Common Core State Standards
specify K-12 English Language
Arts and Mathematics
expectations for college and
career readiness
All students leave high
school college and
career ready
Teachers
and schools have the information
and tools they need to align teaching and learning
Digital Library Tools and resources to support the
formative assessment process
Training Tests Practice Tests
Summative Assessments: College and career readiness
assessments for accountability
Interim Assessments Flexible and open
assessments used for actionable feedback
Common Core aligned instructional programs
20
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Digital Library The Digital Library is an online collection of instructional and professional learning resources contributed by educators for educators.
Assessment Literacy Modules
• Interactive Professional Learning Modules • Resources for educators, students, and families
• Frame Formative Assessment within a Balanced Assessment System • Articulate the Formative Assessment Process • Highlight Formative Assessment Practices and Tools
• Interactive Professional Learning Modules • Instructional coaching for educators • Instructional materials for students
• Demonstrate/support effective implementation of the formative
assessment process • Focus on key content and practice from the Common Core State
Standards for Mathematics and English Language Arts
Instructional Modules
• High-quality vetted instructional resources and tools for educators • High-quality vetted resources and tools for students and families • Reflect and support the formative assessment process • Reflect and support the Common Core State Standards for Mathematics
and English Language Arts • Create Professional Learning Communities
Education Resources
https://www.smarterbalancedlibrary.org/
21
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Training and Practice Tests TRAINING TESTS allow students to become familiar with the assessment software, tools, etc. The Training Tests:
• are organized by grade bands. • each contain 6 to 10 items.
PRACTICE TESTS include: • a “CAT” with about 30 items as well as performance tasks at
each grade level. • the universal tools and, if administered using the secure
browser, the designated supports and accommodations.
Training and Practice Tests can be: • conducted in a testing session using the TA Training Site and
secure browser • taken in a “guest session” using any browser from any location.
22
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Interim Assessments • The Interim Assessments are intended to gauge student progress.
– The Interim Comprehensive Assessment (ICA) is a complete assessment based on the Summative Assessment blueprint including:
• Computer Adaptive Test • Performance Tasks (Classroom Activities are optional)
– The Interim Assessment Blocks (IABs) are shorter, focused assessments that provide more detailed information for instructional purposes.
• Constructed response items within the CAT portion of the ICA and the ICA Performance Tasks require hand scoring at the school level.
• Both the CAT and PT and the hand scoring must be completed for a student to get results for the ICA.
• All of these tests are fixed form – there is only one version of each. See SB Interim Test Administration Guide
23
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Interim Assessment Blocks: ELA/L English Language Arts/Literacy Interim Assessment Blocks 2016-2017
Grades 3, 4 and 5 Grades 6 and 7 Read Literary Texts Read Literary Texts
Read Informational Texts Read Informational Texts Brief Writes Brief Writes
Revision* Revision* Language and Vocabulary Use* Language and Vocabulary Use*
Editing* Editing* Listen/Interpret Listen/Interpret
Research** Research** Opinion Performance Task (Grade 3) Explanatory Performance Task (Grade 7)
Narrative Performance Task (Grade 4,5 ) Argument Performance Task (Grade 6) Grade 8 Grade 11
Read Literary Texts Read Literary Texts Read Informational Texts Read Informational Texts
Brief Writes Brief Writes Edit/Revise Revision*
Listen/Interpret Language and Vocabulary Use* Research** Editing*
Explanatory Performance Task Listen/Interpret Research** Explanatory Performance Task
* IAB is new for 2016–17 ** IAB has been revised for 2016–17
24
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Interim Assessment Blocks: Math Grade 3 Grade 4 Grade 5
Operations and Algebraic Thinking** Operations and Algebraic Thinking** Operations and Algebraic Thinking* Number and Operations –Fractions** Number and Operations – Fractions** Number and Operations – Fractions**
Measurement and Data Measurement and Data* Measurement and Data** Number and Operations in Base Ten* Number and Operations in Base Ten Number and Operations in Base Ten
Geometry* Geometry* Mathematics Performance Task Mathematics Performance Task Mathematics Performance Task
Grade 6 Grade 7 Grade 8 Ratio and Proportional Relationships Ratio and Proportional Relationships** Expressions & Equations I**
The Number System* The Number System** Expressions & Equations II
(with Prob/Stat)* Expressions and Equations** Expressions and Equations** Functions**
Geometry** Geometry* Geometry** Statistics and Probability* Statistics and Probability* Mathematics Performance Task
Mathematics Performance Task Mathematics Performance Task High School
Algebra and Functions I - Linear Functions, Equations, and Inequalities** Algebra and Functions II - Quadratic Functions, Equations, and Inequalities**
Geometry and Right Triangle Trigonometry** Statistics and Probability*
Mathematics Performance Task * IAB is new for 2016–17 ** IAB has been revised for 2016–17
25
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Interim Assessment Hand Scoring Item Counts
Interim Assessment Blocks Mathematics: Except for the Performance Tasks, the IABs in mathematics are machine scored and do not require any hand scoring. The mathematics PTs have 2 to 4 short answer items which require hand scoring. ELA/Literacy: Many of the ELA/Literacy IABs are machine scored and do not require hand scoring. The Revision, Language and Vocabulary Use, Editing, Listen/Interpret, and Research have no items to be hand scored. The following table lays out the approximate number of items to be hand scored in each of the remaining blocks.
Items to be Hand Scored Total Items Subject Grade Test Name CAT Short Ans PT Short Ans PT Essay
ELA 3 ICA – All Grades 3 2 1 46 to 49 Mathematics 3 Math ICA - Grade 3 - 8 0 2 to 4 0 36 to 39
Interim Comprehensive Assessments
Block Name Items
Total Hand Scored Read Literary Texts 15 1 Read Informational Texts 15 1 Brief Writes 6 6 Performance Tasks 6 3 to 4 including the “long write”
26
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Summative Assessments
The Summative Assessment consists of two components which are administered separately but both of which must be completed.
• The Computer Adaptive Test consists of selected response, technology enhanced and short constructed response items.
• Performance Tasks emphasize the application of knowledge on real-world themes.
• Student results are not immediately available. They will be available once both components and external hand scoring in completed.
• There are no longer Classroom Activities for Summative Assessments.
27
Estimated Testing Times for SB Summative Assessments
Content Area Grades CAT PT Total ELA/Literacy HS 1:30 1:30 3:00 Mathematics HS 1:15 0:45 2:00 Both HS 2:45 2:15 5:00
When developing a testing schedule, use the estimated testing times to calculate the number of days and the amount of time it will take to complete an assessment in each content area and grade level. *For High Schools in Hawaii we have found that average times are significantly shorter:
Content Area Grades Computer Adaptive
Test (CAT) hrs : mins
Performance Task (PT)
hrs : mins
Total hrs : mins
English Language Arts/Literacy
3–5 1: 30 2:00 3:30
6–8 1:30 2:00 3:30
HS* 2:00 2:00 4:00
Mathematics
3–5 1:30 1:00 2:30
6–8 2:00 1:00 3:00
HS* 2:00 1:30 3:30
Both
3–5 3:00 3:00 6:00
6–8 3:30 3:00 6:30
HS* 4:00 3:30 7:30
Content Area Grades CAT PT Total
ELA/Literacy HS 1:30 1:30 3:00
Mathematics HS 1:15 0:45 2:00
Both HS 2:45 2:15 5:00 28
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Hawaii State Assessment Calendar: Smarter Balanced
*Subject to change
Some dates have been modified from those in the Memo of May 13, 2016
Smarter Balanced Interim Assessments Content Areas Grade(s)
Testing Window Open Close
ELA/Literacy Mathematics
3 – 8 and 11 08/08/16 06/20/17*
Smarter Balanced Summative Assessments Content Areas Grade(s)
Testing Window Open Close
ELA/Literacy Mathematics
3 – 8 and 11 02/22/17 05/26/17
Grade 11: First Semester Students at Block Schedule Schools ONLY 11/29/16* 05/26/17
Multi-track Schools 3 – 8 Yellow Track 02/22/17 05/26/17
3 – 8 Red, Blue, and Green Tracks 03/20/17* 06/20/17*
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Hawaii State Science Hawaii State Alternate Assessments (HSA-Alt)
End-of-Course Exams Administration
*Subject to change
**Fall Break is October 10-14; regular schedule schools may begin testing on Monday, October 17, 2016.
***Required pursuant to NCLB/Strive HI/ESSA
Kaiapuni Assessment of Educational Outcomes (KĀʻEO)
Hawaii State Assessment Calendar: Other Assessments
Content Area Grades
Number of
Opportunities
Testing Window
Open Close
Science 4 and 8 3 10/11/16** 05/26/17
Science: Multi-track Schools 4 and 8 3 10/11/16** 06/20/17*
Content Areas Grades Mode Testing Window Open Close
Writing Field Test
4 – 9 and 12 Online 09/26/16 10/28/16
ELA/Literacy Mathematics
3 – 8 and 11
Online 02/22/17 05/26/17
Paper/Pencil* 02/22/17 05/19/17
Science 4, 8 and 11 Online 02/22/17 05/26/17
Paper/Pencil* 02/22/17 05/19/17
EOC Exam Administration Testing Window Open Close
Biology 1*** (Required)
Algebra 1 (Optional)
Algebra 2 (Optional)
U.S. History 1 (Optional)
Fall (block schedule schools
only) 11/29/16 12/16/16
Spring 04/25/17 05/26/17
Multi-track Schools 06/06/17 06/20/17*
Summer 06/13/17* 07/20/17*
Assessment Content Areas Grades Testing Window Open Close
KĀʻEO (Hawaiian Language)
Language Arts Mathematics 3 and 4 04/17/17* 05/26/17
KĀʻEO (Hawaiian Language) Science 4 04/17/17* 05/26/17
30
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
NAEP WIDA ACCESS for ELLS 2.0 *
ACT College and Career Readiness Assessments
Hawaii State Assessment Calendar: Other Assessments
Content Area Grades Mode Testing Window Open Close
Mathematics Reading 4 and 8
Tablet
Computers Paper/Pencil
01/30/17
03/10/17
Content Area Grades Mode Testing Window Open Close
Listening Reading Speaking Writing
Kindergarten through 12
Online* or
Paper/Pencil
01/17/17
02/28/17
* See memo dated May 9, 2016 entitled “SY 2016-17 WIDA ACCESS for English Language Learners (ELL) 2.0 Online Administration – Early Adopter Program
Assessment Content Area Grade(s) Mode Testing Window Open Close
ACT Aspire
English Mathematics Reading Science
8, 9 & 10 (optional)
Paper/Pencil and Online
02/28/17
(Includes Multi-track
Middle Schools)
03/31/17
(Includes Multi-track Middle
Schools)
The ACT
English Mathematics Reading Science Writing
11 (required)
Online & Accommodations 02/28/17 03/14/17
Paper/Pencil Administration
Date: 02/28/17
Make Up Testing Date:
03/14/17
31
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Smarter Balanced Summative ELA/Literacy and Mathematics Participation
All students enrolled in grades 3–8 and 11 are required to participate in the Smarter Balanced ELA/Literacy and Mathematics Assessments except:
– Students with the most significant cognitive disabilities who meet the criteria for the HSA-Alternate Assessments
– ELL program students who first enrolled in a U.S. school within the last twelve months are not required to take the ELA/Literacy Assessment.
– Home-schooled students. Home-schooled students may take the Smarter Balanced and HSA Science Assessments at least once at the request of their parents.
– Students who have a significant medical emergency, are receiving services at an out-of-state residential program or meet the requirements of Regulation 4140, Exceptions to Compulsory School Attendance, are exempt for testing.
See SB TAM pg. 22 for more detailed information
32
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Some Additional “Helpful Things to Remember”
33
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Smarter Balanced Administration Tips
• Schools may test students at any time during school hours. • Students may take the interim assessments multiple times
during the testing window but may take summative assessments only once!.
• Assessments are not timed. • Students can be tested in any room that provides a quiet
environment where other students are not participating in learning activities.
• Work with your Technology Coordinator to ensure that the number of students testing does not exceed the capacity for each wireless access point in your school or lab
• Ensure that students are not all clicking the “Begin Test Now” button at the same time. Use a staggered login.
34
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Smarter Balanced Summative Assessments: Test Expiration
Computer Adaptive Test (CAT) A student’s CAT remains active until the student
completes and submits the test or 45 calendar days after the student has begun the test.
Performance Task (PT) The PT is a separate test that remains active only
for 10 calendar days after the student has begun the PT.
35
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
SB Summative Assessments: Pause Rules
CAT During the CAT portion of the test if a test is paused for more than 30 minutes, when the student logs back in he/she is:
– Presented with the page containing the item(s) he or she was working on; – NOT permitted to review or change any previously answered items, – Any highlighted text will be saved but notes on the digital notepad which is an
embedded universal tool will not be saved when a test is paused. Performance Task • There are no pause restrictions. If a test is paused for 30 minutes or more, the
student can return to the section and continue entering his or her responses. • Any highlighted text will be saved but notes on the digital notepad which is an
embedded universal tool will not be saved when a test is paused. • Performance Tasks expire in 10 calendar days so students must complete it within
that timeframe. • NOTE: The ELA PTs have two sections and once a students moves from Section 1 to
Section 2 they cannot return to Section 1.
36
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Major Disruptions Grace Period Extension
A grace period extension (GPE) is granted due to a major disruption, such as a fire drill, a school-wide power or Internet outage.
Test Coordinators may submit a request for a grace period extension (GPE) in TIDE for the student’s test. This GPE will allow the student to go back and review his or her answers.
Note: The student should also not be allowed to resume the test or proceed to the next test opportunity (in the case of an Interim assessment or HSA Science) until the Test Coordinator has been notified of the Assessment Section’s decision regarding the GPE request.
37
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Online HSAP Systems: Support of Mobile Devices
TA Live Site • The TA Site supports mobile devices such as iPads, iPhones,
Chromebooks, Android phones and tablets, and tablets running Windows 8.0, 8.1, and 10.
Student Testing Site (Secure Browser) • Students may take the tests using iPads and Android tablets,
and using Chromebooks. Note: Students using iPads and tablets for SB assessments need to have an external keyboard attached to the iPad.
38
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Teaming for Success
39
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Overview of Online HSAP Process Prepare Technology
Register Online System Users
Complete Training
Conduct Online Assessments
Review Participation in TIDE
Interim Assessments: Hand Scoring Interim Tests
View Student Responses to Interim Using AIR Ways
View Score Reports and Performance Data in ORS
40
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
The School Assessment Team
Canoe Paddlers Roles
• 1st Paddler: Keeps focused on the front of the canoe and is responsible for setting the pace
• 2nd Paddler: Calls out changes to the
paddling sides
• 3rd and 4th Paddlers: Powerhouse paddlers who are the strongest members of the team
• 5th Paddler: Supports the 1st through 4th paddlers and provides extra strength when a moment of weakness may occur
• 6th Paddler: Steersperson who is the overall captain and is responsible for keeping the canoe on course and to provide the necessary encouragement and support for the team
• Alternate Paddlers: Support other paddlers who may need assistance
School Team Members
• Test Coordinator • Curriculum Coordinator • Test Administrators • Technology Coordinator • Student Services Coordinator
• Principal or Vice Principal • School-level colleagues, the Assessment
Section staff, and the HSAP Help Desk
41
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Test Coordinator Role and Responsibilities
Key Responsibilities:
• Complete the online TA Certification Course and review all relevant manuals and guides.
• Identify Test Administrators, Teachers, Proctors and Interim Scorers (as needed) and ensure that they are properly trained.
• Work with the School Assessment Team to create testing schedules and procedures for the school.
• Work with Technology Coordinator to ensure that the current secure browser is installed on all computers to be used for testing and any other technical issues are resolved.
42
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Test Coordinator Role and Responsibilities
Key Responsibilities (continued):
• Work with the Student Services Coordinator to ensure that the appropriate designated supports and accommodations are set in TIDE for all students.
• Monitor testing progress and ensure that all students participate as appropriate.
• Collaborate with the Curriculum Coordinator to oversee the Smarter Balanced training and practice tests as well as the Interim Assessments .
• Disseminate information about testing to families, including Parent Information Booklets and appropriate parent letters.
43
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Key Tasks for the Principal and VP
1. Establish the school’s Assessment Team. 2. Update school contact information in the Intranet. 3. Identify the Test Coordinator(s) in the Test Information Distribution
Engine (TIDE). 4. Maintain regular communication with the Test Coordinators and other
Assessment Team members to ensure all of the necessary tasks are being carried out in a timely manner.
5. Review and approve the Interim and Summative Assessment testing schedules to confirm that they can be successfully implemented.
6. Inform all staff members that they are to report any testing incidents to the test coordinator immediately.
7. Ensure that you, the school administrator, or teacher in charge is available during each summative assessment testing day.
44
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Key Tasks for the Technology Coordinator
1. Ensure that the computer setup for the Interim and Summative Assessments is completed in a timely manner. This includes:
• Verify that your school’s networks and computers meet the minimum technology requirements.
• Conduct network tests and diagnostics. • Download the latest version of the secure browser on all computers.
• Ensure that other technical issues are resolved before testing. 2. Work with the School Assessment Team to develop a testing
schedule for the Summative Assessment. 3. Be available during each day of testing to provide technical
support as needed See the HSAP Technical Specifications Manual and the HSAP Systems Requirements
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Key Tasks for the Curriculum Coordinator
1. Work with school staff to determine various ways they can administer and use the training tests, practice tests, and interim assessments as they prepare for the summative assessments.
3. Become familiar with the Smarter Balanced Usability, Accessibility, and Accommodations Guidelines (UAAG) and the HSAP TIDE User Guide so you can assist teachers when deciding upon appropriate designated supports and accommodations for students and setting them up in the TIDE.
4. Work with the School Assessment Team to develop testing schedules for the Interim and Summative Assessments.
5. If possible, be available during summative assessment testing days to provide support and help to address any issues that arise.
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Key Tasks for the Student Services Coordinator
1. Become familiar with the Usability, Accessibility, and Accommodations Guidelines (UAAG) and the HSAP TIDE User Guide.
2. Meet with the Test Coordinator, SPED Department Chairperson, 504 Coordinator(s), and ELL teacher(s)/tutor(s) to share this information and to pass it on to teachers who provide services for students with disabilities or language acquisition needs.
3. Work with the Test and Curriculum Coordinators to schedule a training session for all of the SPED teachers, 504 care coordinators, ELL teachers/tutors to set accommodations and supports in TIDE. The AIR Uploadable Template can be used to expedite this process.
47
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Key Tasks for the Test Administrators 1. Complete the updated online TA Certification Course and review all
relevant manuals and guides.
2. Prepare the assessment environment.
3. Administer assessments or exams following the directions for administration and monitor progress.
4. Report testing incidents.
5. Shred scratch paper and other handouts in a secure manner if written on by students.
6. Ensure that all student Smarter Balanced Interim Assessment constructed responses are being assigned to be hand scored in THSS.
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Personnel Requirements
General education teacher (full or part time) Must have a Hawai‘i teacher license or credential
Special education teacher, including those hired (full or part time) by a private recruiting agency
Must have a teacher license or credential for Hawai‘i or another state
School counselor Must have a master’s degree in counseling
Instructors Must be teaching a class independently in a content area where there is a shortage of Hawai‘i licensed or credentialed teachers
Long-term substitute teachers Not required to have a Hawai‘i teacher license or credential if they are teaching a class independently
Identified public charter school employees Qualified teaching staff members
Test Coordinator Must meet any one of the above requirements
Identifying Test Administrators
49
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
1. Does your school have an Assessment Team?
2. Has your testing schedule been developed?
3. Who is on the team?
4. Do they understand their roles and responsibilities?
5. What successes have you had?
6. What challenges have you faced / do you face?
7. How do you plan on overcoming the challenges?
How is Your Assessment Team Coming Along?
50
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
OR
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
The Hawaiʻi Statewide Assessment Program Portal has all of the information, documents, training resources, and test administration tools needed to successfully administer the state assessments
alohahsap.org
52
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Online HSAP Systems TIDE Register users and update student info
Live Online HSAP
Administer online the Smarter Balanced Interim and Summative Assessments, HSA Science, EOC Exams and
Alternate assessments
Test Administrator Live Site
Student Testing Site
Online TA Certification Course Training/Practice Site Prepare for assessments
or exams Test Administrator Training Site
Training and Practice Tests
ORS: Results and Reporting
Score Reports
AVA (Assessment Viewing Application) Interim Comprehensive Assessment (ICA) and
Interim Assessment Blocks (IAB) Teacher Hand Scoring System
ICAs
IABs
AIR Ways Reporting TIDE
Monitoring Test Progress
54
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Online HSAP Systems: Secure Login 1. Principals must log into TIDE and enter or verify the school’s Test
Coordinator(s) information. 2. Test Coordinators must then log in and add/verify Test Administrators.
– Newly added users will receive an e-mail from [email protected] that contains a temporary password and a link to sign in to HSAP systems.
– Returning users will be able to use their current username and password.
– A user may request a new password at any time by clicking “Forgot Your Password?”, entering their username and answering their security question.
3. The username for any user is the email address that was entered in TIDE for the user. Contact the HSAP Help Desk at 1-866-648-3712 if you need help with a username or password.
See TIDE User Guide
55
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Key Resources for Online HSAP Testing
Resource Description Primary Audience
HSAP System Requirements Provides information on hardware, software, and Internet requirements for online testing and secure browser installation instructions.
• Technology Coordinators
2016-2017 HSAP TIDE User Guide
Provides screenshots and step-by-step instructions for accessing and navigating the TIDE system.
• Test Coordinators • Student Services
Coordinators 2016-2017 Smarter Balanced Summative Test Administration Manual
Provides information on policies and procedures for administering assessments and exams, including directions for Administration.
• Test Coordinators • Test Administrators
Guide to Navigating the Online HSAP Administration
Provides screenshots and step-by-step instructions for navigating TA Live Site and Student Testing Site.
• Test Coordinators • Test Administrators
Online TA Certification Course The Certification Course Required of Test Coordinators and Administrators
• Test Coordinators • Test Administrators
2016-2017 Online Reporting System User Guide
Provides screenshots and step-by-step instructions for accessing and navigating the Online Reporting System.
• Test Coordinators • Test Administrators • Teachers
Usability, Accessibility, and Accommodations Guidelines
This PowerPoint provides a description of each Smarter Balanced Universal Tool, Designated Support, and Accommodation
• Test Coordinators • Student Services
Coordinators • Teachers
56
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Exploring Smarter Balanced on alohahsap.org Access alohahsap.org, click on the Smarter Balanced card
Find a partner and work your way through the Scavenger Hunt. Identify the appropriate resource and where it can be found on alohahsap.org
After about five minutes we’ll share out the Scavenger Hunt results
57
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
What? and Where? I need the test directions script to read to students before they begin the test. What is the best resource(s)? Where can I find it on the website?
I would like to see my students’ scores on the SB ELA Summative Assessment. Where can I find them on the website?
I have a new Japanese student in my class and I want to provide assessment information to her parents who have limited English language skills. What is the best resource(s)? Where can I find it on the website?
My test session was interrupted by a fire drill. How/where do I report this Test Irregularity?
Our school is buying new Windows computers and I want to know what the minimum requirements are. What is the best resource(s)? Where can I find it on the website?
My math teacher would like to have her students practice using the online Equation Response Editor Tool. Other than the Training Test, where can I direct this math teacher to on the alohahsap.org website?
58
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
What? and Where? We are getting ready send home our Family Reports for the Smarter Balanced Assessments. Where do I find the Sample Parent Cover Letter to Accompany the Family Report?
My school was planning to do testing last Monday but the system was down for scheduled maintenance. Where can I find these dates so we are not surprised again?
I am about to begin testing and want to check the system status of the TA Live Site? Where can I find it on the website?
I need to know the answer to question #30 on the Grade 3 Smarter Balanced ELA CAT Practice Test? Where can I find it on the website?
I would like to see the items on the Grade 8 SB Interim CAT. Where can I find it on the website?
There is a new TA at our school and he needs to understand role and responsibilities better. What resources can help him? Where can they be found on the website?
I have been asked to do hand-scoring at our school. Where will I do that? What are the best resources for me to learn how to do this? Where can I find these resources on the website?
59
HAWAI‘I STATE DEPARTMENT OF EDUCATION
Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance
Let’s Take a 15 Minute Break !
69