Download - Knowledge Survey Wk Shp
-
8/13/2019 Knowledge Survey Wk Shp
1/48
-
8/13/2019 Knowledge Survey Wk Shp
2/48
What is a Knowledge Survey?
Introduced by Nuhfer (1993, 1996), Knipp (2001),and Nuhfer and Knipp (2003)
Series of questions that cover the full breadth of aunit or course
Content and skills objectives
Questions cover different levels of understanding
(e.g., Bloom, 1956)
Students indicate perceived ability to answerquestions
-
8/13/2019 Knowledge Survey Wk Shp
3/48
Question Bloom Level
According to Bloom, what are the different levels ofunderstanding?
Knowledge
Explain how the wiring in the brain can change with age
and use.Comprehension
Use the elements of critical thinking to analyze a sample of
writing. Application
Compare the different levels of reasoning according to
Blooms taxonomy.Analysis
Construct a diagram that synthesizes Blooms levels of
understanding with Fink's (2003) model of significantlearning
Synthesis
Using the list of qualities that distinguish outstanding
students, appraise your own study and learning habits and
suggest a course of action.
Evaluation
Example Knowledge Survey Questions
-
8/13/2019 Knowledge Survey Wk Shp
4/48
-
8/13/2019 Knowledge Survey Wk Shp
5/48
Creating Knowledge Surveys
Compile old exams, quizzes, activities, exercises
Define enduring concepts & learning objectives
Determine content and skills
Write questions that illustrate levels of understanding
Sorted by textbook chapter, source, or topic
-
8/13/2019 Knowledge Survey Wk Shp
6/48
Administering Knowledge Surveys
PaperElectronic
Out-of-class
Data management and analysis more efficient
Survey Responses Not Graded
Beginning of Course
Pre-ExamPost-Course
In subsequent years?
-
8/13/2019 Knowledge Survey Wk Shp
7/48
Text Format of Input File
Explain the elements of critical thinking? {~No answer at this
time ~Know more than 50% =Know detailed answer}
Format in Moodle
Electronic Knowledge Surveys
-
8/13/2019 Knowledge Survey Wk Shp
8/48
Graphics in Knowledge Surveys
-
8/13/2019 Knowledge Survey Wk Shp
9/48
Utility of Knowledge Surveys
Course Design
Clarification of course objectives and structure
Improved organization and preparation
-
8/13/2019 Knowledge Survey Wk Shp
10/48
-
8/13/2019 Knowledge Survey Wk Shp
11/48
EnduringConcepts
Objectives
A Typical Course
Facts
Readings Facts
Facts
Skills Quizzes
-
8/13/2019 Knowledge Survey Wk Shp
12/48
Objectives
Enduring Concepts
Supporting Skills and Facts
Assessments (Formative & Summative)
Instructional Practices & Learning Experiences
A Course That Utilizes Knowledge Surveys
-
8/13/2019 Knowledge Survey Wk Shp
13/48
Utility of Knowledge Surveys
Course Design
Clarification of course objectives and structure
Improved organization and preparation
Students
Full disclosure of course objectives and expectationsStudy guide
Formative assessment tool
Development of self-assessment skills
-
8/13/2019 Knowledge Survey Wk Shp
14/48
-
8/13/2019 Knowledge Survey Wk Shp
15/48
How Students Use Knowledge Surveys
Higher Bloom level questions force me to think criticallyabout the material before the exam
It challenges me to consider the level of understanding,and I can now apply that to all my classes.
It has made me evaluate my knowledge and way of
thinking.
It is good to have such an in-depth guide becausesometimes I dont even realize I dont understandsomething until I am asked to explain it.
How has the knowledge survey contributed to your learning
or changed the way you learn?
-
8/13/2019 Knowledge Survey Wk Shp
16/48
Utility of Knowledge Surveys
Course Design
Clarification of course objectives and structure
Improved organization and preparation
Students
Full disclosure of course objectives and expectationsStudy guide
Formative assessment tool
Development of self-assessment skills
Instructors
Assessment of learning gains
Course assessment
Assessment of instructional practices
-
8/13/2019 Knowledge Survey Wk Shp
17/48
-
8/13/2019 Knowledge Survey Wk Shp
18/48
Two years results for 190 questions:
confidence before and after course
-
8/13/2019 Knowledge Survey Wk Shp
19/48
Knowledge Survey &
Exam Results
Exam I
Exam II
-
8/13/2019 Knowledge Survey Wk Shp
20/48
-
8/13/2019 Knowledge Survey Wk Shp
21/48
-
8/13/2019 Knowledge Survey Wk Shp
22/48
Confidence Before and After Course 2004
-
8/13/2019 Knowledge Survey Wk Shp
23/48
Confidence Before and After Course 2005
-
8/13/2019 Knowledge Survey Wk Shp
24/48
Survey and Examine Results 2004
-
8/13/2019 Knowledge Survey Wk Shp
25/48
Survey and Examine Results 2005
-
8/13/2019 Knowledge Survey Wk Shp
26/48
Course Grade vs Survey or Exam
-
8/13/2019 Knowledge Survey Wk Shp
27/48
-
8/13/2019 Knowledge Survey Wk Shp
28/48
-
8/13/2019 Knowledge Survey Wk Shp
29/48
-
8/13/2019 Knowledge Survey Wk Shp
30/48
-
8/13/2019 Knowledge Survey Wk Shp
31/48
Comparing 2005 Students with those from Several Years Ago
-
8/13/2019 Knowledge Survey Wk Shp
32/48
Comparing 2005 Students with those from Several Years Ago
-
8/13/2019 Knowledge Survey Wk Shp
33/48
Confidence by Bloom Level: Current and Past Students
-
8/13/2019 Knowledge Survey Wk Shp
34/48
Learning Through the Curriculum
-
8/13/2019 Knowledge Survey Wk Shp
35/48
Learning Through the Curriculum
-
8/13/2019 Knowledge Survey Wk Shp
36/48
Senior Survey
0.0
0.5
1.0
1.5
2.0
2.5
3.0
3.5
4.0
65 85 105 125 145 165 185 205 225 245 265 285 305
Questions by Course
Oceanogr.
Dinosaurs
Planetary
En
viron.
P
hysical
Historical
Mineralogy
Structural
Geomorph.
Se
d/Strat
Glaciers
Pa
leobio
Ge
ophys
Petrology
SeniorSem
Skills
-
8/13/2019 Knowledge Survey Wk Shp
37/48
-
8/13/2019 Knowledge Survey Wk Shp
38/48
-
8/13/2019 Knowledge Survey Wk Shp
39/48
H St d t U K l d S
-
8/13/2019 Knowledge Survey Wk Shp
40/48
How Students Use Knowledge Surveys
Yes, they should be continued, but one possible danger is
that it can be good practice to try to figure out [on your
own] what is most important about certain topics/ideas.
Should the use of knowledge surveys in this course be
continued?
H St d t U K l d S
-
8/13/2019 Knowledge Survey Wk Shp
41/48
How Students Use Knowledge Surveys
No. I spent considerable time in high school
discussing learning and feel comfortable withthe way I learn and study.
It is almost ridiculous to think a collegestudent will take the time to not only do an
assignment, but then reflect on what they
learned and assess themselves.
Should the use of knowledge surveys be continued in this
course?
H St d t U K l d S
-
8/13/2019 Knowledge Survey Wk Shp
42/48
How Students Use Knowledge Surveys
I read through the relevant sections every couple ofweeks to see what is expected of me.
Before the test I didnt use it, but now I answer the
questions as I go through the reading.
Used it as a guide before I re-read the course readingsas preparation for the exam.
Before the exam I didnt use it, but now am followingalong with every class period and reading to keep it upto date.
Describe how you use knowledge surveys in this course?
-
8/13/2019 Knowledge Survey Wk Shp
43/48
How Students Use
Knowledge Surveys
Introductory Course
Upper Level Course
-
8/13/2019 Knowledge Survey Wk Shp
44/48
Knowledge Survey
1. What is a knowledge survey?
2. Describe how knowledge surveys differ from exams.
3. Use a knowledge survey to assess learning and instructional
practices in your course.
4. Compare courses with and without knowledge surveys.
5. Design an integrated assessment plan for your course that
includes knowledge surveys.
6. Appraise the validity and utility of knowledge surveys.
a) I don't know the answer
b) I know more than 50%
c) I know the answer
-
8/13/2019 Knowledge Survey Wk Shp
45/48
Knowledge Survey
1. What is a knowledge survey?
2. Describe how knowledge surveys differ from exams.
3. Use a knowledge survey to assess learning and instructional
practices in your course.
4. Compare courses with and without knowledge surveys.
5. Design an integrated assessment plan for your course that
includes knowledge surveys.
6. Appraise the validity and utility of knowledge surveys.
a) I don't know the answer
b) I know more than 50%
c) I know the answer
-
8/13/2019 Knowledge Survey Wk Shp
46/48
Knowledge Survey Results
Knowledge Survey Results
-
8/13/2019 Knowledge Survey Wk Shp
47/48
Knowledge Survey Results
-
8/13/2019 Knowledge Survey Wk Shp
48/48
Knowledge SurveysAn Indispensable Course Design
And Assessment Tool
Karl Wirth
Macalester College
Dexter Perkins
University of North Dakota