Designing Tests and Paper Questions

A Task

• Write down a recent test question or paper topic you used

• Finish this sentence stem: “The most important thing I want students to learn from being in this class is…

Math Example

• Understand certain math functions

• Tests focused on getting the right answer

• Solution• Do the problem • And explain what they did and why

Sociology Example Intro Class for Non-Majors

• Goal:“Be able to apply sociological analysis to what they see around them.”

• Evaluation Tools• Mid term and final with multiple

choice questions• Term paper

Solution

• “Sociological Analysis” journal as main assignment• Apply concepts to what seen

• Summarize sociological perspective• Include detailed observations• Link theories and observations

Creating Objective Tests

• Blueprint• Key concepts in crafting questions• General guidelines• Review

Basic Objective Test Formats

• Multiple Choice• Stems• Options• Distracters

• True-False• Matching• Completion/fill in the blank

Objective Tests That Ask for Higher Order Thinking• Rewriting question

• Interpretive Exercises

• MC question with written explanation why

Warnings

• Higher order questions hard to write

• Many faculty mistake recall for higher order

• One check – if answer can be found in text, not higher order

Objective Tests As Teaching Tool• Small MC test for minimal (if any) points• Use as way of helping students see their level of comprehension• Help professor see areas of confusion• Springboard for deeper conversation

Essay and Papers

• Do I want students to be able to organize information and produce a coherent analysis?

• Do I want to be able to use a variety of written assignments?

In Class Essays versus Papers

• What fits your goal?

Writing Questions/Prompts

• Blueprint (again)• Write• Central to what covered so expected

• Reflect• Central to what I want them to learn• Appropriate level of difficulty

• Do it yourself• Can I expect them to see this; did we do enough

Freedom – Restricted v. Extended• “Explain how Kennedy’s assassination affected passage of the 1964

Civil Rights Act”

• “What two factors were most significant in the passage of the 1964 Civil Rights Act

Scaffolding

• “How does an internal combustion engine work?”

• “Explain the functions of fuel, carburetor, distributor, and the operation of the cylinder’s components in making an internal combustion engine run.”

Choice on Questions to Write On

• More consistent evaluation if no choice of topic

• Choice improves chance of interest and hence quality

A Few More Suggestions

• Length of assignment proportional• Make point value clear• Make expectations clear(er)• Rubrics• Old papers• “Good answer” to topic as class session

Examples of Types of Essay/Paper Topics