kde:oaa:dsr: 2/6/20121. 2 test security—addition of new checks and processes to monitor...
TRANSCRIPT
KDE:OAA:DSR: 2/6/2012 1
2
TEST SECURITY—addition of new checks and processes to monitor appropriate administration of state-required tests
DATA QUALITY—collaborative process between OAA and school/district staff to ensure accurate reporting of test results
KDE:OAA:DSR: 2/6/2012
Recent loss of certification for Kentucky educators emphasizes a serious issue.
Senate Bill 64 (2012 Kentucky General Assembly) an ACT relating to assessment ethics has been filed. authorize prosecution of violations (a prosecuting
attorney and the Attorney General may investigate allegations of violations and prosecute violations);
require the Office of Education Accountability to periodically review assessment results and anomalies; and provide for fine upon conviction of not more than $1,000 and disciplinary action by the Education Professional Standards Board.
KDE:OAA:DSR: 2/6/2012 3
Senate Bill 64 requirements unlawful for any school district employee to allow
examinees to view assessment questions in advance, copy test booklet contents, provide guidance to assist examinees to arrive at correct answers, change student responses, make answer keys available;
fail to follow test security protocol, fail to report violations, or follow any rules established by the Kentucky Board of Education (KBE);
require superintendent and principal to enforce policies;
require the KBE to adopt statistical guidelines for determining testing irregularities;
4KDE:OAA:DSR: 2/6/2012
Appropriate training for Administration Code and Inclusion rules
Signatures on Appropriate Practices Form and Administration Code
Seating charts that reflect everyone in each testing room (adults and students)
Bubbling of testing room location codes by content area tests on student response booklets
DACs collect BAC certification and KDE collects DAC certification form (provided by KDE, not vendor)
KDE:OAA:DSR: 2/6/2012 5
Certification Form DACs and BACs
E-mail from KDE/OAA and copy in
DAC/BAC manualCompleted at end of
year to reflect all testing
Certification form similar to prior years
KDE:OAA:DSR: 2/6/2012 6
Test window visits Review of seating charts Collection of DAC certification forms Review/audit of randomly collected AAA
Folders for alternate assessment students Analysis of outlier test results by Office of
Education Accountability Analysis by vendors (i.e., erasure and others)
KDE:OAA:DSR: 2/6/2012 7
Analysis by vendor can produce multiple types of information/reports at room, school or district levels.Large score changes for a studentLarge mean score increasesProbability of matched response analysisPrevious year’s distribution around scoresPattern analysisComparison of individual student scores by item type
KDE:OAA:DSR: 2/6/2012 8
Get the facts straight.Record the date and time of the incident.List all involved (i.e., staff, volunteers, students).
Identify content area and test parts impacted.Identify specific content question(s), if applicable.
Record what you learn.Report the incident.
KDE:OAA:DSR: 2/6/2012 9
Support Documents Testing Allegation Reporting Form Notarized Statements written and signed by each individual involved (teacher, proctor, BAC, principal and/or others). One statement signed by multiple individuals is not acceptable.Testing ScheduleSeating Chart
KDE:OAA:DSR: 2/6/2012 10
Support Documents Verification of Administration Code TrainingVerify/Proctor Signature SheetNon-disclosure Agreement (classified/volunteers)Student Name & SSIDFor an allegation involving special education:
verification of student test accommodation(s). verification of Inclusion of Special Populations training. a signed copy of the Code of Ethics, record of testing room and test
administrator for allegations regarding alternate assessment.
KDE:OAA:DSR: 2/6/201211
Correctness must happen first in Infinite Campus
KDE/OAA Student Data Review and Reporting (SDRR) Application will be used for two critical data accuracy functions:
Rosters Required by regulation Record of accountability for all grades 3-12 Testing information for some tests
Data Review (cleanup before reporting)KDE:OAA:DSR: 2/6/2012 12
• Students enrolled a full academic year, any 100 instructional days, shall be included in calculations for Achievement, Gap, Growth and College/Career Readiness.
• Graduation Rate calculations shall include both students enrolled and students earning diplomas.
13KDE:OAA:DSR: 2/6/2012
14
INSERT TABLE
KDE:OAA:DSR: 2/6/2012
Every student enrolled on the first day of the test window must be tested. (Participation rate still reported.)
Every student in grades 3-12 must be placed in a grade for assessment purposes.
Students take the tests associated with the grade in which they are enrolled on the first day of the test window. Grade 3 students are tested whether or not they are exiting
primary or moving to grade 4. If a grade 3 student is in grade 3 again next year, the
student repeats the grade 3 test. If a student skips a grade, the students takes only the tests
associated with the current grade of enrollment.KDE:OAA:DSR: 2/6/2012 15
“A1” means a school under administrative control of a principal and eligible to establish a school-based decision-making council.
“A1” school is not a alternative program operated by, or as a part of, another school.
“Alternative” program means all other education programs not classified as A1.
KDE:OAA:DSR: 2/6/2012 16
START
Has this student been enrolled in
this school for 100 instructional days
this school year?
YES
NO
Student scores will count
in this school’s accountability.
Has this student not been
in any one school but has been enrolled in this district for 100 instructional days
this school year?
Student scores will count in district’s
accountability.
YES
NO
Student scores will count in state’s accountability
only.
Has this student been enrolled in a
school or district outside this districtfor 100 instructional
days this school year?
NO
YES
Student scores will count in
another school’s ordistrict’s
accountability.
Flowchart for Determining AccountabilityFor Students in A1 Schools for the 2012 Kentucky Performance Rating for Educational Progress (K-
PREP) Every student enrolled on the first day of
the testing window will be tested for participation rate purposes. Accountability will be determined
by full academic year.
Has this student been
enrolled in another school in this district for 100 instructional
days this school year?
NO
Student scores will count in other
school’s Accountability.
YES
KDE:OAA:DSR: 2/6/2012 17
Flowchart for Determining Accountability For Students in Alternative Programs for the 2012 Kentucky Performance Rating for Educational Progress (K-PREP)
Accountable to A1 school and/or district where student was enrolled a full academic year or where the student would have attended if not enrolledin the alternativeprogram.
an A1 school’s or
district’s policy?
YES
agovernmentalagency or the court system?
Was the student enrolled
a full academic year in the A1 and alternative
program combined orin the alternativeprogram only?
NO
Was the student enrolledin an A1 school
or district for a fullacademic year
beforeplacement in an
alternativeprogram?
YES YES
Accountable to the state
YES
NO
START: Was the student placed in the
alternative program by:
KDE:OAA:DSR: 2/6/2012 18
The Kentucky Board of Education approved new accommodation rules with revisions to Inclusion regulation on February 1, 2012.
The new rules will impact the 2012-2013 academic year and will impact state-required testing beginning in August 2012.
KDE:OAA:DSR: 2/6/2012 19
All grades (3-8 and HS writing) have separate test booklets and student answer booklets.
Test booklets are larger. New printing process has increased the size
of the test booklets (i.e., number of pages), the occurrence of blank pages and pages with one multiple-choice items.
Bigger books mean more boxes in shipment.
KDE:OAA:DSR: 2/6/2012 20
Tests are timed.
Timing chart has been revised and first-year transitional buffer has been added.
Timing charts display the expected time needed to complete each K-PREP test.
KDE:OAA:DSR: 2/6/2012 21
KDE:OAA:DSR: 2/6/2012 22
KDE:OAA:DSR: 2/6/2012 23
In spring 2012, any student that does not complete Parts B or C in the expected time may use up to an additional twenty minutes, for all content areas except writing.
During the first K-PREP administration, the Kentucky Department of Education will study completion times for Parts B and C. This additional time will be reviewed for its use in future.
KDE:OAA:DSR: 2/6/2012 24
Every English Learner (EL) student in grades k-12 must take an English Language Proficiency (ELP) assessment annually.
ACCESS—ELP test for ELs has an Alternate ACCESS available.
Districts determine the most appropriate ELP assessment to use (ACCESS—grades k-12 or Alternate ACCESS—grades1-12).
The Participation Guidelines for Alternate Assessment are an important reference.
KDE:OAA:DSR: 2/6/2012 25