where kids count

Where Kids Count

OAEP 2013 Spring Conference Tammy Hrosch, MCEP

Presentation Disclaimer

Significant changes to the Ohio Local Report Card System are ongoing. This presentation is based on documentation

as it is published today. There are many changes happening as we speak and those changes should be

carefully monitored as you verify your EMIS data and Local Report Card Data using the Where Kids Count calculations.

2

Objectives• EMIS Data Integrity• Using ODE EMIS Reports•Where Kids Count Rules•Where Kids Count EMIS Reports• Secure Data Center

3

Data Integrity – EMIS Elements

4

• IRNs• District IRN (Reporting District)• Building IRN (Attending Building – FS)• Majority of Attendance IRN (FN)• Accountability IRN (FN)• District of Residence IRN (FS)• How Received IRN (FS)• Sent to IRN (FS)• Feeder School IRN (DN)

Data Integrity – More Elements

• Gender (GI)• Summative Race (GI)• Student Grade Level (FD)• Disadvantagement (FD)• Disability Condition (FD)• Limited English Proficiency (FD)• Migrant Status (FD) iLRC Statistical Data • Percent of Time (FS)

5


• Student Test Scores and Accommodations(FA)• Student Graduation Requirement (FE)• Foreign Exchange Graduation Plan (FD) • Military Compact Graduation Alternative (FN)• Acceleration (FB)• Spring Administration Math Test Date (DL)

6

Data Integrity - Subgroups • FY13 Subgroups for Annual Measureable Objectives (AMOs)• 30 or more students (building and or district level)• All students• Economically Disadvantaged • Limited English Proficient• Students with Disabilities• Asian *and* Native Hawaiian or Pacific Islander• African American• American Indian or Alaskan Native• Hispanic• Multiracial• White

7


• Gifted (GG) • Identified in Math, Reading or Superior

Cognitive• Identified, served, courses, program codes- not

sure what will be used.• Used for Progress Component which spans

years. • Calculations are forthcoming. In the meantime,

be sure your data is complete and correct. 8


• Course Data – Future Element• Check coding on courses including elements

such as AP, IB, PSEO, etc. • Very important to report PSEO courses now.• Your current data may be used for future

measures.

9


• Ohio Achievement Tests (Grades 3 though 8)• Fall Administration – Grade 3 Reading only• Spring Administration

• Ohio Graduation Tests (Grades 10 and 11)• Fall Administration• Spring Administration

10

2012-2013 Performance Indicators• 3rd, 4th, 6th and 7th Grade Reading and Math (75%)• 5th and 8th Grade Reading, Math and Science

(75%) • 10th Grade Reading, Math, Science, Social Studies

and Writing (75%)• 11th Grade (Cumulative) Reading, Math, Science,

Social Studies and Writing (85%)

11

Data Integrity – Review

Test scores• Have 3rd grade OAA fall reading scores been

loaded?• Have fall OGT scores been loaded?• Have all other spring tests been loaded?• OAA Spring results due back June 15, 2013• OGT Spring results due back May 13, 2013

12

Data Integrity - ReviewTest Scores• Identify students who didn’t test and why• Enter manual test records as necessary• Add accommodations if applicable• Update graduation requirement

exemptions• Be sure all test records are loaded or

entered13

Data Integrity – Review

• Enlist the help of building staff to verify accuracy of student data (gender, race/ethnicity, grade level).• Are LEP and Migrant students updated?• Are disadvantagement elements correct?• Are disabled students reported correctly and

completely?• Are student graduation requirement elements

reported correctly?14

Data Verification – Correct Errors

• Student Information System Verification Errors• Data Collector Validation Errors• Data Collector “Preview” and “Review”

files• Excluded Records• Record Type Files

15

Data Verification - ODE ReportsODE Reports that contain WKC EMIS data • Missing OAT (OAA)• Missing OGT• Gifted (future element)• IEP Future Fund• Missing SE Event• Gen Issues - Maybe

16

Where Kids Count Rules

WKC Rules come from the Office of Accountability and are currently being updated. Watch their

webpage for updated documentation.

17

Where Kids Count Rules

• First overarching rule-

• Must attend a full academic year

• If they didn’t attend a full academic year no other rules apply. (Of course there is an exception so stay tuned!)

• Student counts at the state level 18

Full Academic Year Criteria• Student is continuously enrolled from the end

of October Count Week through the spring math test administration date, designated as follows:

• March 19 for all grades except 3 – 8• March 19 for all Alternate Assessments (both

OGT and Achievement)• May 10 for grades 3 – 8 (except students

taking the Alternate Assessment) 19

Majority of Attendance IRN

• The IRN of the building or district where the student is continuously enrolled from the end of October Count Week through the spring test administration date. (Full Academic Year Criteria)

• Must be a building within your district or your district IRN. This cannot be a building or district IRN that is not your own.

20


• Report the district IRN when the student was enrolled for a full academic year in the district but was enrolled in multiple buildings in the district during that time.

• Report ****** when the student was not enrolled in the district for a full academic year.

21


• Special Situations – report building IRN they would attend if they attended your district and if they attended a full academic year and-

Sent to Joint Vocational School (Full or Part-time)Sent to Post Secondary Enrollment OptionSent to County Board (BDD/MRDD)Sent to Contract Career TechSchool Aged Educated at ESC

22


• Do not assume software mass updates for the Majority of Attendance IRNs are correct• Start assigning MOA IRNs as soon as the

spring testing administration date passes

23

Accountability IRN

• The building IRN within the district that is responsible for the student’s performance measures.

• Student simultaneously enrolled in two buildings, or attending a special program in another building.

24

Accountability IRN

• Use the Accountability IRN to count the student at the “responsible” building.

•Must be enrolled a full academic year to report anything except ******.

25

Important Rules

•WKC Calculations are based on the student’s FS Standing Coding that was effective on the last day of school for the student. • Disability and LEP status are as of the start

of the testing window if they are in a tested grade level.• Economic Disadvantagement as of the

students last day of school. 26

Accountability • Levels (Three Report Cards)• Building Level and District Level and State Level• District Level and State Level• State Level

• Entities• Educating Building/District• Sending Building/District• Resident Building/District

27

Accountability• Where Kids Count rules look at the Majority of

Attendance IRN, the Accountability IRN and the student’s percent of time.• The rules then consider the How Received and

Sent To elements.• The following are general rules to determine

where the student counts.

28

Counts at Educating BuildingFull Academic Year and % of time > than 0

How Received =

• “*” Not Applicable (reporting entity is educating)• “3” In-state, non-resident, non-tuition, non-

contract student (unauthorized student)• “7” Non-resident residing with grandparent

(ORC 3313.64)• “8” Non-resident senior year• “9” Non-resident open enrollment student

29

Counts at Educating BuildingFull Academic Year and % of time > than 0

• How Received =• “A” Non-resident student, parent is a

district employee (ORC 3312.64)• “C” Foster placed or court placed with a

relative• “S” Superintendent’s agreement • “W” Non-resident attending under Title 1

Public School Assistance

30

Counts at Sending Building• Meets Full Academic Year Criteria and • Sent to =• “CT” Contract Career-technical Education

Participant• “JV” Joint Vocational School District Participant• “ES” Educational Service Center Preschool

Program Participant• “PS” Post Secondary Enrollment Options Program

Participant• “MR” BDD/MRDD Program Participant• “OS” State School (OSB/OSD) Program Participant

31

Counts at Resident District• Meets full academic year criteria and

How Received Element = • “B” Non-resident Student Attending a Special

Education Program• Counts at educating district for the participation

rate calculation• Counts at Resident/Sending district percent

proficient at district level

32

Counts at the State Level

• Meets full academic year criteria and How Received Element =

• “P” Court-Placed Students, Excluding Foster Care

• “T” Students Placed in Institutions, Non-Court Ordered

33

FAY Exception

• A student who is enrolled at the end of October Count week and then leaves the district as a Court Ordered Institutional Placement (Sent to CI) or as a Non-Court Ordered Institutional Placement (Sent to NI) and who subsequently returns to the district prior to the end of the school year will be considered as continuously enrolled for a full academic year.

34

Counts at Educating District

• Meets full academic year criteria and has How Received Element =

• “M” Student Attending a Community School

• Specific rules apply to Conversion Community Schools and Start-Up Community Schools

35

Conversion Community Schools

• Students will also be included in the sponsoring district’s accountability calculations unless the sponsoring district has completed a Dropout Recovery Conversion Community School Verification 2010-2011 form through the Office of Community Schools and the application was approved by the agency.

36

Start-Up Community Schools

• The students will NOT be included in any traditional school district’s accountability calculations unless the community school and traditional school district have completed District Roll-Up of Affiliated New Start-Up Community School Performance Data FY2011 from through the Office of Community Schools.

37

Counts at Educating STEM District

• Meets full academic year criteria and has How Received Element =

• “K” Student Attending a STEM District

• This is a for a STEM “District”. Dayton Regional STEM school and the Metro School are STEM Districts.

38

Counts at STEM School and Resident District

• Meets full academic year criteria and How Received Element=• “9” Non-resident, Open Enrollment Student:

Inter-District• This is for a STEM “School” that is a building in a

school district. • Students are included in the accountability

calculations for their respective districts of residence. 39

Counts at State Level• Meets full academic year criteria and LEP Status

= “L”• “L” LEP Enrolled in U.S. Schools for First Time

A recently arrived Limited English Proficient student who has been enrolled in U.S. schools no more that 180 school days AND Not previously exempted from taking the spring administration of either of the State’s English language arts assessments (reading or writing) • See the EMIS Manual for reporting instructions.

40

Attending/Home on WKC Reports• Attending Home IRN is a combination of-• Reporting District IRN• District of Resident IRN• How Received IRN• Sent to IRN

• Attending Home Indicator is a combination of-• How Received IRN• Sent to IRN

• Converted back to pre-FY09 EMIS format• See the Bridge Flow Report Explanation for A/H Codes

41

Where Kids Count Reports

Check your WKC reports early but remember GIGO.• 2013n_stu_wkc_atest.pdf (OAA)• 2013n_stu_wkc_atest.csv• 2013n_stu_wkc_atest_summ.csv• 2013n_stu_wkc_ntest.pdf (Non-Tested)• 2013n_stu_wkc_ntest.csv• 2013n_stu_wkc_ntest_summ.csv• 2013n_stu_wkc_otest.pdf (OGT)• 2013n_stu_wkc_otest.csv• 2013n_stu_wkc_otest_summ.csv

42

Where Kids Count Reports

• Last year, WKC reports were released in early July• Two Report Formats- PDF and CSV• PDF is sorted by WKC IRN, WKC Type, Grade, then SSID• PDF only contains basic information but is ready to print• Testing CSV files are over 60 columns wide• CSV files can be sorted, filtered, narrowed down, etc. • Summary CSV files contain student totals by subject and

WKC Type and is over 90 columns wide

43

WKC Reports (pdf)

44

WKC Reports (csv)

45

ECON_DISADV LEP DISABIL RACE SID REPORT_BLDG_IRN WKC_TYPE WKC_IRN WKC_NAME READING WRITING MATH SCIENCE SOCIAL_STUDIES FILE_IRN DISTRICT_IRN DISTRICT_NAME REPORT_BLDG_NAME MOA_IRN ACCT_IRN AH_IRNL W XXXXXXXXX 34181 12 State Total 47241 47241 Beavercreek Shaw 47241

1 L H XXXXXXXXX 34181 12 State Total 47241 47241 Beavercreek Shaw 472411 L W XXXXXXXXX 34181 12 State Total 47241 47241 Beavercreek Shaw 472411 L A XXXXXXXXX 34181 12 State Total 47241 47241 Beavercreek Shaw 472411 L W XXXXXXXXX 34181 12 State Total 47241 47241 Beavercreek Shaw 47241

L W XXXXXXXXX 22251 12 State Total 47241 47241 Beavercreek Main 47241L A XXXXXXXXX 34181 12 State Total 47241 47241 Beavercreek Shaw 47241L W XXXXXXXXX 11528 12 State Total 47241 47241 Beavercreek Ferguson 11528 11528 47241L A XXXXXXXXX 11528 12 State Total 47241 47241 Beavercreek Ferguson 47241

1 L A XXXXXXXXX 11528 12 State Total 47241 47241 Beavercreek Ferguson 11528 11528 47241L H XXXXXXXXX 43299 12 State Total 47241 47241 Beavercreek Herman K Ankeney 43299 43299 47241L W XXXXXXXXX 11528 12 State Total 47241 47241 Beavercreek Ferguson 11528 11528 47241L W XXXXXXXXX 11528 12 State Total 47241 47241 Beavercreek Ferguson 11528 11528 47241L W XXXXXXXXX 11528 12 State Total 47241 47241 Beavercreek Ferguson 11528 11528 47241

1 L A XXXXXXXXX 11528 12 State Total 47241 47241 Beavercreek Ferguson 51045L A XXXXXXXXX 11528 12 State Total 47241 47241 Beavercreek Ferguson 47241L B XXXXXXXXX 11528 12 State Total 47241 47241 Beavercreek Ferguson 11528 11528 51045L A XXXXXXXXX 43299 12 State Total 47241 47241 Beavercreek Herman K Ankeney 47241N W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N 1 W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N 15 A XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N 12 H XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N 12 W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N 10 W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N 9 W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N 1 W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241

1 N W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241

1 N 8 M XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241N 6 W XXXXXXXXX 11528 1 11528 Ferguson Y Y 47241 47241 Beavercreek Ferguson 11528 11528 47241

WKC Reports (csv) Summary

46

FILE-IRN DIST-IRN RPTING-BLDG-IRN RPTING-BLDG-NAME SUBMIT-DATE STUDENT-ATTEND-TYPE-01 STUDENT-ATTEND-TYPE-02 STUDENT-ATTEND-TYPE-0347241 47241 43299 Herman K Ankeney 0 0 0 047241 47241 11528 Ferguson 0 0 0 047241 47241 50757 Fairbrook 0 266 0 147241 47241 47241 Beavercreek 0 0 0 647241 47241 1966 Beavercreek 0 609 0 047241 47241 34181 Shaw 0 341 0 147241 47241 29322 Parkwood 0 342 0 047241 47241 22251 Main 0 383 0 047241 47241 38083 Valley 0 281 0 0

WKC IRN Assignment

•When both the Majority of Attendance IRN and the Accountable IRN contain building IRNs with different values, the Accountability IRN value will be used to populate the WKC IRN. For all other conditions, Majority of Attendance IRN will be used to populate the WKC IRN.

47

WKC AdjustmentsWhere Kids Count Type Code 01

• If the WKC IRN assignment is a building and both the Majority of Attendance IRN and Accountability IRN contain the same building IRN, the WKC IRN remains as assigned and the WKC TYPE is assigned the value '01'.

48


• Student is enrolled in one building within a district for a full academic year.

• Student counts at the building where the full academic year criterion is met, AND counts at the district, and state levels, for the % proficient, performance index, and attendance rate calculations.

49


• If the WKC IRN assignment is a building but the Majority of Attendance IRN and Accountability IRN do not contain the same building IRN, the WKC IRN remains as assigned and WKC TYPE is assigned the value '02'.

50


• Student is enrolled in one building within a district for a full academic year, AND the district has determined that the student should be included in another building within the reporting district for accountability purposes.

51


• Student counts at the building level in the building indicated in the “Accountability IRN” by the educating entity, AND counts at the district, and state levels, for the % proficient, performance index, and attendance rate calculations.

52

WKC AdjustmentsWhere Kids Count Type of 03

• If the WKC IRN assignment is a district, the WKC IRN remains as assigned and the WKC TYPE is assigned the value '03'.

• Student is enrolled in the district, but not in one building within the district, for a full academic year.

53


• Student counts at the district level and the state level for the % proficient, performance index, and attendance rate calculations.

54


• If the WKC IRN assignment is the state, the WKC IRN remains as assigned and the WKC TYPE is assigned the value '04'.

• Student is NOT enrolled in either a building or a district for a full academic year.

55


• Student counts at the state level for the % proficient, performance index, and attendance rate calculations.

56


• If the student's attending home status is '1P' or '1T' or their Attending/Home status is between '22' and '26' and the student status is a 'P' or 'T', then the WKC IRN is assigned the State IRN and the WKC TYPE is assigned the value '05'.

57


• Student is placed into an institution either via a court-placement or a parent-placement. Student can be in this same situation and sent to Contract Career Tech, JVS, ESC, PSEO or MRDD.• Student counts at the state level for the %

proficient, performance index, and attendance rate calculations.

58


• If the WKC IRN assignment does not equal “******” and the student's attending home status is '1B' or their Attending/Home status is between '22' and '26' and student status is 'B', the WKC IRN is assigned the Attending/Home District IRN and the WKC TYPE is assigned the value '10'.

59


• Student participates in a special education cooperative program in another district; and is in the educating district for a full academic year. Student can be in this same situation and sent to Contract Career Tech, JVS, ESC, PSEO or MRDD.

60


• Student counts in the Resident/Sending District for the % proficient, performance index, and attendance rate calculations. The student will count at the educating district for participation rate.

61


• If the student is participating in an Autism Scholarship Program, then the WKC IRN is assigned the State IRN (‘******’) and WKC Type is assigned the value '11'. • Student Participates in the Autism

Scholarship• Student counts in the state level

calculations, if student has attendance or takes a statewide test in a public district. 62


• If the student has a Limited English Proficiency (LEP) equal to “L”, then the WKC IRN is assigned the State IRN (‘******’) and WKC TYPE is assigned the value '12'.

63


• “L” LEP Enrolled in U.S. Schools for First TimeA recently arrived Limited English Proficient student who has been enrolled in U.S. schools no more that 180 school days AND Not previously exempted from taking the spring administration of either of the State’s English language arts assessments (reading or writing)

64


• State level calculations: % proficient, Performance Index, and Participation rate for reading

65


• Originally the WKC Type 15 identified students who counted in a building indicated by the Spring Test Administration IRN. Since this IRN is no longer reported, the calculation will look at the building that the student was reported in on the FS records on the date of the Date of Spring Administration-Math Test Element (DL) for participation if the Accelerated Assessment Accountability IRN (FB) is ******.

66

WKC AdjustmentsWhere Kids Count Type of 15• Acceleration is reported through the acceleration

record and this calculation no longer looks for Y4 accommodations.• Watch for revisions in the Performance Index

calculations for 13N from the Office of Accountability for accelerated students.• See Roger or put in a ticket if you have questions.

67


• A recently arrived Foreign Exchange student who has been enrolled in U.S. schools less than 180 school days AND does not plan to graduate in Ohio.

• State level calculations: % proficient and

Performance Index68

Alternate Assessment Cap• The number of students taking the alternate assessment

reported with a score at or above proficient cannot consist of more than 1% of the number of students who took the test (both STR and ALT).

• There is one cap at the district level that is applied separately to two different populations (State and Federal)

• State Cap• All tests grades 3 through 8, 10 and 11.

• Federal Cap• Grades 3 through 8 and grade 10 Reading and Math

• Y = Included in CAP and counts as a non-passing score69

Troubleshooting the WKC Report

• Are the students counting where they should?• Are there students who should be on this

report and are not? • Are the elements correct for the students?• Building staff who actually know the

students are a great resource.

70

Secure Data Center• Difference between ODE Reports and the SDC• WKC reports are released from ODE through your

ITC periodically. • SDC data is scheduled to be loaded over the

weekend and once during the week. • If errors are found in the SDC calculations, the

data can be recalculated by ODE. • SDC data should be considered the most accurate.

• Check the SDC often and drill down into the data to verify. 71

FY2013 and Beyond

• David Ehle’s session – “ODE-Auditor’s Report”

• Chris Wollard’s session – “ODE- Report Card & Accountability”

• Keep yourself updated on the latest information and changes!

72

73

Questions?

where kids count

Documents

grade reading

current data

fall administration

local report card data

grade oaa fall

irn fssent

th grade cumulative

spring tests