1. 1. What is a CAT?
2. 2. Introduction
3. 3. What is a CAT?
4. 4. What is a CAT? COMPUTER ADAPTIVE TEST + performance task
5. 5. What is a CAT? COMPUTER ADAPTIVE TEST Often referred to as C-A-T or a CAT.
6. 6. The Computer Part of a CAT
7. 7. What is a CAT? COMPUTER
8. 8. What is a CAT? more efficient and appropriate for students than a typical paper-and-pencil test COMPUTER
9. 9. What is a CAT? allows students to have more engaging test questions from the real world COMPUTER
10. 10. What is a CAT? Items might include: videos or audio, PowerPoint slides, or interactive test questions. COMPUTER
11. 11. What is a CAT? allow students flexibility and accessibility put the student in control give access to helpful tools and resources COMPUTERS
12. 12. What is a CAT? Usability, Accessibility and Accommodations Guidelines Can be found on the Smarter Balanced website.
13. 13. The Test Part of a CAT
14. 14. What is a CAT? TEST The Smarter Balanced Test is designed to assess how well a student has mastered the expectations of the Common Core State Standards in both English language arts or mathematics for his or her grade level.
15. 15. The Adaptive Part of a CAT
16. 16. What is a CAT? ADAPTIVE COMPUTER ADAPTIVE TEST
17. 17. What is a CAT? In the adaptive portion of Smarter Balanced tests, the questions (or items) are chosen for each student so that the test is neither too hard nor too easy. ADAPTIVE
18. 18. What is a CAT? While the CAT is adaptive, it operates from logical rules that can be inspected or examined, and that are known and published. ADAPTIVE
19. 19. What is a CAT? COMPUTER ADAPTIVE TEST Provides a unique and effective way to test what a student has learned.
20. 20. What is a CAT? COMPUTER ADAPTIVE TEST ? ? ? ? ? ? ?
21. 21. Copyright 2013 by Educational Testing Service. All rights reserved.
22. 22. How can a CAT do that?
23. 23. What is a CAT? How can a CAT do that? 1) Bank of Test Items 2) A Recommended Blueprint 3) Programming (or Algorithm) 4) Algorithm Constraints
24. 24. What is a CAT?
25. 25. What is a CAT? ? ? ? ? ? ?
26. 26. What is a CAT? ? ? ? ? ? ?
27. 27. What is a CAT? How does it know which question to pick?
28. 28. What is a CAT? Test Blueprint focuses the selection of questions from the test bank to the appropriate content so the structure of the test is similar for every student selects the precise questions based on the individual students responses to previous questions in the test
29. 29. What is a CAT?
30. 30. What is a CAT? Important Rules to make the test Balance (enough of the concept?) Question Type (Selected Response? Constructed Response?) Reading Length (Short? Medium? Long?) Difficulty (appropriate for the grade level?)
31. 31. How does a CAT work for the student?
32. 32. What is a CAT? How will it work for me?
33. 33. How will it work for the student? The test starts with an item from a pre- determined difficulty level. It may be based on average difficulty for the grade, or it may be based on information known about the student from previous tests.
34. 34. How will it work for the student? Question Selection The student receives questions based on his or her response to the previous questions. The computer program quickly selects a new question after reviewing how well the student performed on all the previous questions. Based on the responses, the program selects a question that fits the test blueprint and gives the best information about what the student knows. This is how a CAT can customize each test so it is an accurate measure of any students skills.
35. 35. How will it work for the student? Questions will ADAPT If the student continues to answer questions correctly, the questions covering the blueprint will continue to get more challenging. If the student starts missing the answers to questions, the program will start to select questions that are easier. The program adapts to how the student is performing.
36. 36. How will it work for the student? Responses Because the program knows which questions are harder and which are easier, several students may have answered a similar number of questions correctly, but the student who has answered the more challenging questions correctly will achieve a higher score.
37. 37. How will it work for the student? That's it! A students score is based on the difficulty of the items that were right or wrong, not on the total number of correct answers. Of course, it all seems so simple when described like this. But there is a very complex process happening within the CAT engine to make all of these determinations simultaneously with predictability built in.
38. 38. CAT Review
39. 39. CAT Defined Introduction Let's review the parts that make up a CAT COMPUTER ADAPTIVE TEST Computer Adaptive Test
40. 40. CAT Defined The COMPUTER is important in CAT because: it makes the test more efficient and appropriate for every student; it allows students more flexibility and accessibility during testing; and it has the ability to include videos, audio, PowerPoint slides, and interactive test items. Computer Adaptive Test
41. 41. CAT Defined The ADAPTIVE part of the CAT makes the test unique for every student: it looks to see if the student response is correct; and it selects the next question to build a custom-made test for each student. Computer Test Adaptive
42. 42. CAT Defined The Smarter Balanced TEST is testing how well a student has mastered the expectations of the Common Core State Standards in English language arts (ELA) and mathematics. The test ends when the student has answered a sufficient number of questions that satisfy the requirements of the blueprint and provide a good estimate of the students proficiency. Computer Adaptive Test
43. 43. Better Assessment Results
44. 44. What is a CAT? How does a CAT provide better assessment results? With a CAT, each student will demonstrate the level of his or her content knowledge based on the item selection that adjusts to his or her particular responses.
45. 45. How does a CAT provide better assessment results? It is ACCURATE It is INDIVIDUALIZED It is SECURE It is EFFICIENT It delivers FAST RESULTS This provides a testing experience that is a more accurate way to evaluate mastery of a subject by minimizing the difference between what a test score indicates and a students actual knowledge and abilities.
46. 46. How does a CAT provide better assessment results? It is ACCURATE It is INDIVIDUALIZED It is SECURE It is EFFICIENT It delivers FAST RESULTS Because the program knows which questions are harder and which are easier, the student will see items that are neither too easy nor too hard.
47. 47. How does a CAT provide better assessment results? It is ACCURATE It is INDIVIDUALIZED It is SECURE It is EFFICIENT It delivers FAST RESULTS Not all students receive the same questions; therefore, cheating is more difficult than it would be on a paper test with fewer items and with paper forms that can be copied.
48. 48. How does a CAT provide better assessment results? It is ACCURATE It is INDIVIDUALIZED It is SECURE It is EFFICIENT It delivers FAST RESULTS It provides items in an order that best determines a students proficiency.
49. 49. How does a CAT provide better assessment results? It is ACCURATE It is INDIVIDUALIZED It is SECURE It is EFFICIENT It delivers FAST RESULTS Many items are scored in real time by the computer. Student test scores and reports are not delivered until the entire test, including parts requiring human scoring, has been evaluated.
50. 50. How does a CAT provide better assessment results? It is ACCURATE It is INDIVIDUALIZED It is SECURE It is EFFICIENT It delivers FAST RESULTS The students testing experience will be their very own and provides them with the chance to show what they know.
51. 51. What is a CAT? Now you know!