knowledge survey wk shp

8/13/2019 Knowledge Survey Wk Shp

1/48


2/48

What is a Knowledge Survey?

Introduced by Nuhfer (1993, 1996), Knipp (2001),and Nuhfer and Knipp (2003)

Series of questions that cover the full breadth of aunit or course

Content and skills objectives

Questions cover different levels of understanding

(e.g., Bloom, 1956)

Students indicate perceived ability to answerquestions


3/48

Question Bloom Level

According to Bloom, what are the different levels ofunderstanding?

Knowledge

Explain how the wiring in the brain can change with age

and use.Comprehension

Use the elements of critical thinking to analyze a sample of

writing. Application

Compare the different levels of reasoning according to

Blooms taxonomy.Analysis

Construct a diagram that synthesizes Blooms levels of

understanding with Fink's (2003) model of significantlearning

Synthesis

Using the list of qualities that distinguish outstanding

students, appraise your own study and learning habits and

suggest a course of action.

Evaluation

Example Knowledge Survey Questions


4/48


5/48

Creating Knowledge Surveys

Compile old exams, quizzes, activities, exercises

Define enduring concepts & learning objectives

Determine content and skills

Write questions that illustrate levels of understanding

Sorted by textbook chapter, source, or topic


6/48

Administering Knowledge Surveys

PaperElectronic

Out-of-class

Data management and analysis more efficient

Survey Responses Not Graded

Beginning of Course

Pre-ExamPost-Course

In subsequent years?


7/48

Text Format of Input File

Explain the elements of critical thinking? {~No answer at this

time ~Know more than 50% =Know detailed answer}

Format in Moodle

Electronic Knowledge Surveys


8/48

Graphics in Knowledge Surveys


9/48

Utility of Knowledge Surveys

Course Design

Clarification of course objectives and structure

Improved organization and preparation


10/48


11/48

EnduringConcepts

Objectives

A Typical Course

Facts

Readings Facts

Facts

Skills Quizzes


12/48

Objectives

Enduring Concepts

Supporting Skills and Facts

Assessments (Formative & Summative)

Instructional Practices & Learning Experiences

A Course That Utilizes Knowledge Surveys


13/48


Course Design



Students

Full disclosure of course objectives and expectationsStudy guide

Formative assessment tool

Development of self-assessment skills


14/48


15/48

How Students Use Knowledge Surveys

Higher Bloom level questions force me to think criticallyabout the material before the exam

It challenges me to consider the level of understanding,and I can now apply that to all my classes.

It has made me evaluate my knowledge and way of

thinking.

It is good to have such an in-depth guide becausesometimes I dont even realize I dont understandsomething until I am asked to explain it.

How has the knowledge survey contributed to your learning

or changed the way you learn?


16/48


Course Design



Students

Full disclosure of course objectives and expectationsStudy guide

Formative assessment tool

Development of self-assessment skills

Instructors

Assessment of learning gains

Course assessment

Assessment of instructional practices


17/48


18/48

Two years results for 190 questions:

confidence before and after course


19/48

Knowledge Survey &

Exam Results

Exam I

Exam II


20/48


21/48


22/48

Confidence Before and After Course 2004


23/48

Confidence Before and After Course 2005


24/48

Survey and Examine Results 2004


25/48

Survey and Examine Results 2005


26/48

Course Grade vs Survey or Exam


27/48


28/48


29/48


30/48


31/48

Comparing 2005 Students with those from Several Years Ago


32/48

Comparing 2005 Students with those from Several Years Ago


33/48

Confidence by Bloom Level: Current and Past Students


34/48

Learning Through the Curriculum


35/48

Learning Through the Curriculum


36/48

Senior Survey

0.0

0.5

1.0

1.5

2.0

2.5

3.0

3.5

4.0

65 85 105 125 145 165 185 205 225 245 265 285 305

Questions by Course

Oceanogr.

Dinosaurs

Planetary

En

viron.

P

hysical

Historical

Mineralogy

Structural

Geomorph.

Se

d/Strat

Glaciers

Pa

leobio

Ge

ophys

Petrology

SeniorSem

Skills


37/48


38/48


39/48

H St d t U K l d S


40/48


Yes, they should be continued, but one possible danger is

that it can be good practice to try to figure out [on your

own] what is most important about certain topics/ideas.

Should the use of knowledge surveys in this course be

continued?

H St d t U K l d S


41/48


No. I spent considerable time in high school

discussing learning and feel comfortable withthe way I learn and study.

It is almost ridiculous to think a collegestudent will take the time to not only do an

assignment, but then reflect on what they

learned and assess themselves.

Should the use of knowledge surveys be continued in this

course?

H St d t U K l d S


42/48


I read through the relevant sections every couple ofweeks to see what is expected of me.

Before the test I didnt use it, but now I answer the

questions as I go through the reading.

Used it as a guide before I re-read the course readingsas preparation for the exam.

Before the exam I didnt use it, but now am followingalong with every class period and reading to keep it upto date.

Describe how you use knowledge surveys in this course?


43/48

How Students Use

Knowledge Surveys

Introductory Course

Upper Level Course


44/48

Knowledge Survey

1. What is a knowledge survey?

2. Describe how knowledge surveys differ from exams.

3. Use a knowledge survey to assess learning and instructional

practices in your course.

4. Compare courses with and without knowledge surveys.

5. Design an integrated assessment plan for your course that

includes knowledge surveys.

6. Appraise the validity and utility of knowledge surveys.

a) I don't know the answer

b) I know more than 50%

c) I know the answer


45/48

Knowledge Survey

1. What is a knowledge survey?

2. Describe how knowledge surveys differ from exams.

3. Use a knowledge survey to assess learning and instructional

practices in your course.

4. Compare courses with and without knowledge surveys.

5. Design an integrated assessment plan for your course that

includes knowledge surveys.

6. Appraise the validity and utility of knowledge surveys.

a) I don't know the answer

b) I know more than 50%

c) I know the answer


46/48

Knowledge Survey Results



47/48



48/48

Knowledge SurveysAn Indispensable Course Design

And Assessment Tool

Karl Wirth

Macalester College

Dexter Perkins

University of North Dakota

knowledge survey wk shp

Documents