kansas state assessment updateswprsc.fatcow.com/handouts/wp-content/uploads/2011/… · ·...

Kansas State Assessment UpdateAgents of Change

Mr. Bill E. Losey

[email protected]

Professional Learning…

Innovative Solutions

@billlosey SWPRSC

mailto:[email protected]

• Understand New Proficiency Scores

• Know where Assessment resources

are located

• Know the testing windows

• Understand there is much more than

the KAP Summative

• Understand the KITE portal

Today’s Objectives



• Understand testing of ELLs

• Understand the nature of adaptive

testing

• Understand the new ticketing

procedure

• Understand reactivation

• Understand Special Circumstance

Codes




• Overview of DLMs

• Discuss specific assessed Content

areas

• Understand test security and ethics




• The end goal is not to have kids do

well on a test.

• The end goal is how kids perform

daily in math, ELA, Science, History

Government, CTE, Fine Arts, PE

with a deeper level of understanding.

The number one objective

Today



• Notes from KSDE Pre Conference

October 26, 2015

2016 State Assessment



• Measure specific claims related to

the Kansas College and Career

Ready Standards (KCCRS) as

identified in the Performance Level

Descriptors (PLDs)

• Provide information for calculating

Annual Measurable Objectives

(AMOs) and for state accreditation

Summative Assessment

Objectives



• Report individual student scores

along with the student’s performance

level.

• Provide subscale and total scores

that can be used with local

assessment scores to assist in

improving a building or district’s

programs.

Summative Assessment

Objectives



• Successful test administration –

THANK YOU!

• Set proficiency levels and cut scores

• Scale Scores – range from 220-380

with 300 as the level 3 cut score

2015 RECAP



• Level 1: indicates that a student is

not performing at grade level

standards, and additional supports

are needed

• Level 2: indicates that the student is

doing grade level work as defined by

the standards but not at the depth or

level of rigor to be considered on-

track for college readiness

Proficiency Scores



• Level 3: indicates that a student is

performing at academic expectations

for that grade level and is on track to

being college ready.

• Level 4: indicates that the student is

performing above expectations for

that grade level and is on track to

being college ready.

Proficiency Scores



2015 2016 2017 2018>>>

Growth 1st year of new

assessment data

2nd year of assessment

data. Calculate SGP.

1st year of growth AMO

Continue Growth AMO Continue Growth AMO

RNP 1st year of new

assessment data.

Determine percent

non-proficient


data. Determine

percent below

proficient. Average wit

h2015 to establish

calculation or AMO for

2017.

2nd year of RNP AMO Continue RNP AMO

Achievement 1st year of new

assessment data.

Analyze performance

category scores and

API construction


data. Analyze

performance category

scores and API

construction. Establish

AMOs

1st year of achievement

API AMO

Continue Achievement

API AMO

Gap 1st year of new

assessment data.

Analyze API scores

and those of lowest

performing 30%


data. Analyze API.

Establish AMOs

1st year of GAP AMO Continue CAP AMO

Accountability



ESA

WAIVER

Participation

Rates – 95%

Graduation

Rates

• Resources– KSDE website: http://ksde.org/Default.aspx?tabid=407

– Help Desk Phone: 785-296-1978

• 15-16 Assessments Documentation and

Resources

– Test Security

– Examiner’s Manual

– Overview Document

• Accommodations Documents and Resources

– Accommodations Manual

– Scribing Guidelines

• Assessment Q&A

2016 State Assessments



http://ksde.org/Default.aspx?tabid=407

• Resources

– KAP (Kansas Assessment Program)

– Also referred to as the KITE OR CETE

website: http://www.ksassessments.org• For KITE questions: [email protected]

• Phone: 785.864.3537

– KITE• Kite Documentation

• FAQs

• KITE Client Downloads and instructions

• KITE Requirements

• KITE Local Caching Server




http://www.ksassessments.org/


• Resources

– Dynamic Learning Maps (DLM)

• KSDE Website -

http://ksde.org/Default.aspx?tabid=407

• KSDE Contact Deb Mathews –

[email protected]

• DLM website http://dynamiclearningmaps.org/kansas





http://dynamiclearningmaps.org/kansas

• Resources

– Career and technical Education (CTE)

– KSDE Contact: Jay Scott

[email protected]

– Career Pathways Collaborative (cPass)

• Kite website: http://careerpathways.us/





• Select “Overview”

KAP Assessment Document



• On the left select the PLD for grade

levels

KAP Assessment Document



• CETE will begin processing TEST records 10/26/15

• Summative General Assessments in ELA, Math, Science,

and History / Government

– Performance tasks February 16 – April 28

• Estimated length of time to complete tasks– Math – 30 minutes

– MDPT 60 minutes (2 activities)

– Machine Scored March 16 – April 28

• Estimated length of time to complete assessment– Math 90 minutes (4 parts)

– ELA 90 minutes (4 parts)

– Science – 90 minutes (2 parts) grades 5, 8, 11

– History Government – 30 minutes (2parts) grades 6, 8, 11

• Total Testing Time

– 8th grade student 6.5 hours

2016 Testing Window



A Message from President

Obama



http://ktla.com/2015/10/25/president-obama-wants-to-

limit-standardized-testing-announces-new-guidelines/

http://ktla.com/2015/10/25/president-obama-wants-to-limit-standardized-testing-announces-new-guidelines/

• Alternate Assessment – Dynamic Learning Maps

– English Language Arts and Math

• Embedded Window: November 5 – February 29

• Summative Window: March 16 – April 28

• English Language Learner – ELP 21– Headphones with microphones will be required

– Testing Window: currently published March 16-April 28

• Listening– Fall field test is no longer necessary

– Will not adapt until 2017

2016 Testing Windows



Available Assessments # of

sections

# of

Items

Opens Closes

General CTE (Operational) 4 100 9/10/15 5/1/16

Comprehensive Ag (Operational) 3 100 9/10/15 5/1/16

Power Structural and Technical Systems

(Operational

1 20 9/10/15 5/1/16

Animal Systems (operational) 3 100 9/10/15 5/1/16

Plant Systems (Operational) 3 100 9/10/15 5/1/16

Horticulture Module (Operational) 1 25 9/10/15 5/1/16

Manufacturing Production (Operational) 3 100 9/10/15 5/1/16

Design and Pre Construction (Pilot) 3 86-87 9/10/15 12/18/15

Finance (Pilot 3 91-92 9/10/15 12/18/15

2016 Testing Window



cPass

• Career Pathway Assessment

System

– General CTE Assessment for students

midway through their pathway

– Pathway specific Assessment

• For students completing a pathway

– Part 1 – computerized assessment

– Part 2 – performance assessment (CCQ)

2016 Assessments



Caching



• Districts must register all eligible students

via TEST records in KIDS for the

appropriate test type– A KITE ticket grouping feature has been added that

allows districts to organize students by teachers or

classes.

– For DLM, TEST records must have the proctor ID ad

proctor name fields completed and TASC records

must be submitted to KIDS for rosters to be available

for the interim assessments

Registering Students for

Testing



• STCO records must be submitted to allow

teachers access to student rosters for

summative assessments

• TASC records will be used for interim

assessments

• Schools must submit an EXIT record for any

student who stops attending the school

– If EXIT record is not submitted for a students no

longer attending, that student will be recorded as “not

tested” and negatively impact the school’s

participation rate.

Registering Students for

Testing



• Educator Portal

– View rosters

– View students Personal Needs and

Preferences (PNP)

– Create and assign students to interim

test sessions

– Monitor test sessions while students

are taking the assessments

– Generate Data extracts

KITE



• For teacher accounts to function

correctly KIDS STCO records must

be submitted.

• TASC records are needed for interim

assessments

KITE



• Personal Needs Profiles (PNPs)

– Allows teachers to control the types of

accommodations that will ne presented

in the students’ tests

• Display enhancements

• Language and Brail– Spanish translation of certain words or phrases will

be available on the general assessment in math and

science

– No Spanish translations will be available for the ELA

or HGSS assessments

– ASL will be available for listening passages, math,

MDPT, and practice tests.

KITE



• Audio and environment support

– Calculators – an on screen calculator is

available for certain items

• Students are not permitted to use their own

calculator

KITE



• Recent Arrivals

– Ell students who have attended any US

school for less than one calendar year

from the date of the assessment

window opens.

• On or after February 15, 2015

– Must take the math and science

assessments.

• Results count only for participation

English Language Learners



• None Recent Arrivals

– Must take all state assessments

– Results count for participations and

accountability

– Once identified, the student must take

the ELPA21 until scoring proficient for 2

consecutive years

English Language Learners



• Instead of preprinting tickets, online

password tickets will be generated.

– The password will differ by subject,

grade, and part (hard break)

• Do not let a student take the wrong test

collection or form for any reason.

• Do not send ticket passwords of students

now in a different school or district to a

new school

New Tickets



• All students take part 1 of the

assessment.

• After completing part 1, the

computer calculates their score and

chooses the appropriate level for

part 2.

– Part 2 will require the student to enter a

new password ticket to begin testing.

Adaptive Test in ELA & Math



• Repeat scenario for part 3.

• The field test (part 4) is not adaptive

and will be randomly assigned

between either parts 1 & 2 or parts 2

& 3 at the end of the assessment.

– The field test will never be

administered in part 1

Adaptive Test in ELA & Math



Adaptive Model



Stage 1

25 Items

Stage 2

15 hard

items

Stage 2

15

medium

items

Stage 2

15 easy

items

Stage 3

15 very

hard items

Stage 3

15

medium

hard

items

Stage 3

15

medium

easy

items

Stage 3

15 easy

items

Non Adaptive Pieces

Field test

stage 15

items

Performance

task

• Enter SC Codes in KITE

– Not on a KSDE excel spreadsheet

– In the event a student cannot take or

complete the summative assessments,

a test coordinator at the building or

district level will need to enter the

special circumstance for the student.

Special Circumstances (SC)

Codes



• The SC may or may not count

against participation

• Codes marked “contact KSDE” must

be approved and entered by Lee

Jones or Mark Stephenson at KSDE

Special Circumstances (SC)

Codes



• Reuse

• If a student’s session ends before

the student finished, the student may

reuse the username, password, and

ticket password if it occurs within 90

minutes of original login.

Reactivation



• Reactivate

– After 90 minutes, the student’s test

session must be reactivated for the

password and ticket password to work.

– To reactivate a test session for a

student, contact the district or building

coordinator

Reactivation



• Performance tasks must be hand

scored

– Performance tasks are administered in

a different testing window

– Scoring will be virtual and needs to be

completed before the end of the school

year (May 15)

Performance Tasks



• Option 1 – district/building scoring

day

• Option 2 – individuals may volunteer

to score independent of an

organized event

Performance Tasks



• Math performance task items were

included in the standard setting

process over the summer. Scores

will be included as part of the

student’s summative score.

• ELA performance task standard

setting will occur later this school

year.

Performance Tasks



• Teachers administering DLM

assessments must:

– Complete the required training

modules and pass a required test

– Review/revise the first contact survey

for each student

– Review / revise the PNP for each

students

Dynamic Learning Maps



• Choose / identify ELA and Math

Essential Elements (EEs) for each

student.

– Each grade has a different number of

EEs that are required. The number of

EEs for each grade is spelled out in the

ELA and Math blueprints.

– http://dynamiclearningmaps.org/kansas




http://dynamiclearningmaps.org/kansas

• Embedded Assessments

– There will only be one testlet (3-5

items) per Essential Element.

– DLM is like a formative process,

instruct then test. Since there is only

one testlet per EE this year you will

only test once for each EE chosen at

the linkage level.

– As students progress to the next

linkage level there will another testlet.




• Summative Assessment

– 5 testlets will be randomly chosen from

the EE testlets

• Student Summative Score

– Embedded + Summative = Reported

Student Score




• This is a pilot year for grades 5, 8,

and 11

• 20016/2017 will be operational

• No items from 2014-2015 will be

used

• Based on the Next Generation

Science Standards (NGSS)– http://community.ksde.org/LinkClick.aspx?fileticket=MCOLp_

kHGNU%3d&tabid=5785&mid=14106

Science



http://community.ksde.org/LinkClick.aspx?fileticket=MCOLp_kHGNU%3d&tabid=5785&mid=14106

• Grades 6, 8, and 11

• Multiple choice, technology

enhanced items Machine scored

• Part 1 + Part 2=25-35 minutes

History / Government



• One significant change is that the days of

the tested indicator are gone. Tested

indicators were intended to give teachers

a better handle on what the assessment

was going to be addressing, but were

misused and abused to become either the

only things that students were expected

to learn, or were used for drill-and-kill rote

memorization activities. At each of the

tested levels, the full scope of the

standards will be addressed on the

assessment.

Science



• Another change is that the assessment will be moving

grade levels to better match the standards. Our current

standards are grade specific for grades K-5, so the

elementary assessment will be given at the fifth grade

level. Though this assessment will target fifth grade

standards, it should NOT be interpreted that science

instruction isn't needed until 5th grade. These standards

build conceptually across grades and there is NO WAY

that students not receiving quality science education

across elementary school will be either successful on this

assessment, or more importantly, prepared to learn

science at the middle school level. The middle school

standards are grade-banded for grades 6-8; consequently

the middle school assessment will occur during the eighth

grade year. Likewise, the high school standards are

grade-banded and the assessment will take place in the

11th grade year.

Science



• Another shift on this assessment is that there will

be more than just multiple choice items. The

assessment will include a variety of different item

types, including technology enhanced items such

as "drag and drop." There will also be simulation

items as a part of the assessment that will allow

students to manipulate scenarios, collect data,

and run experiments. All of the items will be

selected response items. Whether students are

presented with data, graphics, information, or a

simulation to gather data and make

observations, they will select their answer in

some way from a given set of responses.

Science





• Thank you for coming to today’s workshop!

• Please go to

• www.swprsc.org

• Click on: Professional Learning

• Click on: Workshop Evaluation

• Your feedback is important to us!

http://www.swprsc.org/