andrea m. karkowski, jody s. fournier, richard m. ashbrook
TRANSCRIPT
Andrea M. Karkowski, Jody S. Fournier, Richard M. Ashbrook, Terry D. Lahm
IDEA User Group Meeting, Nashville, Tennessee, October 2012
Assessment and Learning
Student Learning Goals
Align IDEA Objectives to Student Learning Goals
Map IDEA Objectives Across Courses
Help Students Understand Objectives and Goals
Document the Assessment Results
Use Results to Improve Courses and Curricula
Ph
oto
by
A. M
. Kar
kow
ski o
f D
r. T
erry
Lah
m, S
epte
mb
er 1
7, 2
012
, Cap
ital
Un
iver
sity
Photo by A. M. Karkowski of Lanee Williams, Jordan Aires, Jessica Heck, Andre Cousin, Capital University, September 17, 2012
Jan
et L
eig
h in
Psy
cho
, Dir
ecte
d b
y A
lfre
d H
itch
cock
, Un
iver
sal P
ictu
res
Direct Measures
Indirect Measures
Metacognition
Develop Learning Goals for Programs and Majors
University Learning
Goals
Department Learning
Outcomes
APA Recommendations
(Halonen et al., 2006)
Develop a sense of
values that guides
personal decision
making
Sensitivity to ethical
issues
Weigh evidence, tolerate
ambiguity, act ethically, and
reflect other values that are the
underpinnings of psychology
Develop intercultural
competencies
Recognition of ethnic,
cultural, social and
gender diversity
Recognize, understand, and
respect the complexity of
sociocultural and international
diversity
Students will develop…
A broad and deep knowledge base incorporating both social and natural
science aspects of psychology
Understanding of different theoretical traditions
Methodological competence in statistics, research design and assessment
methods including the use of technology for these purposes
Practical research, laboratory, or field experience to generalize a scientific
style of thought to the realm of application
Effective communication skills
Sensitivity to ethical issues
A recognition of ethnic, cultural, social and gender diversity
DEPARTMENT LEARNING GOAL
A broad and deep knowledge base incorporating both social and natural science aspects of psychology
Understanding of different theoretical traditions
IDEA OBJECTIVE
Objective 1: Gaining factual knowledge (terminology, classification, methods, trends)
Objective 2: Learning fundamental principles, generalizations, or theories
DEPARTMENT LEARNING GOAL
Methodological competence in statistics, research design and assessment methods including the use of technology for these purposes
IDEA OBJECTIVE
Objective 4: Developing specific skills, competencies, and points of view needed by professionals in the field most closely related to this course
Objective 9: Learning how to find resources for answering questions or solving problems
DEPARTMENT LEARNING GOAL
Practical research, laboratory, or field experience to generalize a scientific style of thought to the realm of application
IDEA OBJECTIVE
Objective 3: Learning to apply course material (to improve thinking, problem solving, and decisions)
Objective 11: Learning to analyze and critically evaluate ideas, arguments, and points of view
DEPARTMENT LEARNING GOAL
Effective communication skills
IDEA OBJECTIVE
Objective 5: Acquiring skills in working with others as a member of a team
Objective 8: Developing skill in expressing oneself orally or in writing
DEPARTMENT LEARNING GOAL
Sensitivity to ethical issues
A recognition of ethnic, cultural, social and gender diversity
IDEA OBJECTIVE
Objective 10: Developing a clearer understanding of, and commitment to, personal values
-- NONE --
Three IDEA Objectives Do Not Align with Department Learning Goals
Objective 6: Developing creative capacities (writing, inventing,
designing, performing in art, music, drama)
Objective 7: Gaining a broader understanding and appreciation of
intellectual/cultural activity (music, science, literature, etc.)
Objective 12: Acquiring an interest in learning more by asking
questions and seeking answers
IDEA
Objective
Required Courses for Psychology Major
100 110 200 210 220 300 310 320 330 340 350 370 410
1. E E I E E E E I I
2. E I E I E E E E
3. I I E E E I I E I I E E
4. I E E E I E I E I
5. I I
6. This IDEA Objective is not aligned with department learning goals and thus is not assessed.
7. This IDEA Objective is not aligned with department learning goals and thus is not assessed.
8. E I E E I
9. E E I
10. I I
11. I E I I I E
12. This IDEA Objective is not aligned with department learning goals and thus is not assessed.
Ph
oto
by
A. M
. Kar
kow
ski o
f M
. To
rello
, S. S
agar
ia, J
. Fo
urn
ier,
J. L
oo
pst
ra,
S. S
ale
em
, K. B
ell,
Se
pte
mb
er
17, 2
012
Metacognition
Understanding Learning Goals Linking New and Prior Learning
Building Knowledge Structures that Facilitate Future Learning
Student View of Metacognition
Requires Work
Benefits of Metacognition
Metacognition Academic Success
(Gourgey, 1998; Nietfeld et al., 2005)
Teach Students
About Course and Department Learning Goals and Objectives
How Learning Goals are Themes Across the Curriculum
Syllabi for Required Psychology Courses
Include a Map the Department Learning Goals for Required Courses
Seemingly Different Courses Can Achieve the Same Learning Goal
Identify when Course Activities Target Particular Learning Goal
Understand that Learning Goals Are Achieved by Accumulation of Many
Different Learning Activities
When students have built and can use the
metacognitive structures, ratings of the IDEA
Objectives then provide one way to assess whether
students perceive that learning goals are being met.
Assumptions
Our primary concern is whether or not the
course meets the course objectives
A single data point (i.e., a data from a single
class) is not useful without the larger context
Student Ratings of
Meeting Course
Objectives
(page 2 of the IDEA
Feedback Form)
Excel Spreadsheet
http://www.capital.edu/psychology-resources/
Can tailor to individual classes
Can graph classes over time
Directions
Three Tabs
IDEA Objectives
Course Number
SEMESTER F'08 S'09
MEANS 70 82
PSYCH 350 Semester 1 Semester 2
21. Gaining factual knowledge… 70 80
22. Learning fundamental principles… 80 90
23. Learning to apply course material… 70 80
24. Developing specific skills, competencies, and points of view… 60 70
25. Acquiring skills in working with others as a member of a team
26. Developing creative capacities…
27. Gaining… appreciation of intellectual/ cultural activity…
28. Developing skill in expressing myself orally or in writing 70 90
29. Learning how to…use resources for answering questions…
30. Developing… personal values
31. Learning to… evaluate ideas, arguments, and points of view 70 80
32. Acquiring an interest in learning…
0
10
20
30
40
50
60
70
80
90
100
F'08 S'09 F'09 S'10 F'10 S'11 F'11 S'12 F'12 S'13 F'13 S'14
% S
tud
en
ts A
gre
ein
g
Course Met Course Objectives for PSYCH 350
How do you get faculty to do this?
Requested in Annual Report
Includes reflection and future plans
Requested in Promotion and Tenure Process
Discussion of Course Objectives
Courses Taught by Multiple Instructors
Examine Key Learning Objectives
Forced to Choose Only 3-5 Objectives
Identify how Course Activities Support Objectives
Faculty: I really think “Developing skill in
expressing myself orally or in writing” should be
listed as one of the objectives for PSYCH 110.
Chair: What do you do in 110 that requires
students to speak and write so that they can
develop those skills?
Faculty: Well, nothing, really.
Are course objectives being met?
Do enough courses target particular
objectives?
Develop Student Learning Goals
Align Department Student Learning Goals with IDEA
Objectives
Map IDEA Objectives across
the Curriculum
Help Students Develop
Metacognition
Document IDEA Results
Use IDEA Results & Discussions
about Aligning Goals & Mapping
Objectives to Improve Courses
& Curricula
Jody S. Fournier
Terry D. Lahm
Richard M. Ashbrook