David Taylor, Ed. D.Director, Educational and Technology ServicesUniversity of Texas Dental Branch at Houston

Writing and conceptualizing Rubrics• Reflecting• Listing criteria• Grouping and labeling• Application

Incorporating rubrics into scoring process Automated scoring with rubrics

Online tool for creating, administering and analyzing surveys Includes Current Student Inventory, with over 500 validated

questions for evaluating educational uses of technology Choose from a large collection of model surveys and validated

questions created by Flashlight staff or adapt surveys, rubrics, and item banks created by other users, at other institutions

Use a variety of question types to create your own items, including rubrics;

Flashlight Online

• Create rubricsFlashlight Online includes two rubric builders, so a rubric can be shown in an expanded or collapsed form.

• A matrix approach to rubricsFaculty can collect rubric-based student responses , for specific skill assessments, in a single, shared database and compare across different courses, different years

• Sharing RubricsFlashlight Online users can build on rubrics originally created by other users.

• Multiple sources of assessmentSend a rubric to a variety of judges who then each use the rubric to rate the work.

Dimension 1: Problem Identification

Question and assessment authoring Question banking by learning objective Integration with learning management

systems Instant feedback to

enhance learning Secure delivery for

high-stakes exams On-demand results,

reports and item analysis

Captivate/Robodemo Drag and Drop Essay Explanation Fill in Blanks Hotspot Likert Macromedia Flash Matching Matrix

Multiple Choice Multiple Response Numeric Pull-down List Ranking Select a Blank Spoken Response Text Match True/False Yes/No

The Questionmark Scoring Tool Offers:◦ In-line grader’s annotations as well as overall comments ◦ Up to 12 scoring dimensions within each rubric ◦ Individual scoring comments for each dimension of the

rubric ◦ Automated, customized, template-driven emails relaying

scores and comments to participants ◦ The ability to assign different rubrics to the same

question, depending on how the question is used

The Questionmark Scoring Tool helps both individual and multiple graders maintain consistency in marking constructed answers. This is achieved by using the Scoring Tool to define rubrics, or scoring rules, for each question.

Can computers be trusted for natural language reading and scoring?◦ Can a machine read, understand and grade an

essay response? ◦ Issues and problems

Simulators as assessment devices for clinical skills

General guides and information on Rubrics http://www.educationatlas.com/rubrics.html http://www.cotf.edu/ete/teacher/rubrics.html http://www.tltgroup.org/resources/Rubrics.htm#ReferencesGuides

Rubric for Rubrics http://www.tltgroup.org/resources/Rubrics/A_Rubric_for_Rubrics.htm

“First Generation” Tools for Creating Rubrics http://rubistar.4teachers.org/index.php http://www.teach-nology.com/web_tools/rubrics/

“Second Generation” Tools for Creating Rubrics: Flashlight 2.0 http://www.tltgroup.org/resources/flashlight/rubrics.htm (Mullinix) http://www.tltgroup.org/Flashlight/FLO2/rubrics.htm#Creating_rubrics

(Ehrmann)

Questionmark Perception http://www.questionmark.com/us/perception/index.aspx