facilitating curriculum development: principles, practices and tools peter wolf april 2013
TRANSCRIPT
![Page 1: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/1.jpg)
Facilitating Curriculum Development:
Principles, Practices and ToolsPeter Wolf
April 2013
![Page 2: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/2.jpg)
Workshop Goals
• Identify ways to foster engaged curriculum development
• Develop best practices/principles for facilitating curriculum development
• Identify activities/tools that can enhance curriculum development initiatives
![Page 3: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/3.jpg)
Case Study
• Tasks:– What would you do in this situation– What would you recommend as the next
step?
• Questions:– What activities and/or tools might you
use as a facilitator?– What best practices and/or principles
would you suggest as a facilitator?
![Page 4: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/4.jpg)
Key Questions
1. What are the programme outcomes that we want to foster in our students?
• Competencies• Objectives• Key Indicators• Etc…
![Page 5: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/5.jpg)
Attributes of the ‘Ideal Graduate’
• University Learning Outcomes• Existing Program Outcomes• Professional Organizations/Accreditation• Other Similar Programs
• Consider disciplinary norms and languages• Articulate what is unique about your
program
![Page 6: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/6.jpg)
Degree Level Expectations
• Depth and Breadth of Knowledge • Knowledge of Methodologies • Application of Knowledge• Communication Skills • Awareness of Limits of Knowledge • Autonomy and Professional Capacity
http://www.cou.on.ca/content/objects/Undergrad%20Degree%20Expectation%20FINALen1.pdf
![Page 7: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/7.jpg)
University of Guelph
Learning Objectives (2013)
• Critical and Creative Thinking – Inquiry and Analysis, Problem Solving, Creativity, Depth and
Breadth of Understanding
• Literacy – Information Literacy, Quantitative Literacy, Technological
Literacy, Visual Literacy
• Global Understanding – Global Understanding, Sense of Historical Development, Civic
Knowledge and Engagement, Intercultural Competence
• Communicating – Oral Communication, Written Communication, Reading
Comprehension, Integrative Communication
• Professional and Ethical Behaviour – Teamwork, Ethical Reasoning, Leadership, Personal
Organization and Time Management
![Page 8: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/8.jpg)
Bachelors of Arts & Sciences Sample Program Outcomes
• Pose & solve problems by drawing on & integrating diverse protocols & methods
• Oral & written communications, for academic & general audiences
• Conduct traditional & electronic research, in humanities/social sciences & scientific contexts
![Page 9: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/9.jpg)
Embedding Outcomes
OCAV DLE
UniversityOutcome
Degree Outcome
Course Outcome
![Page 10: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/10.jpg)
Case Study
• Tasks:– What would you recommend as the next
step?
• Questions:– What activities and/or tools might you
use as a facilitator?– What best practices and/or principles
would you suggest as a facilitator?
![Page 11: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/11.jpg)
Key Questions
1. What are the programme outcomes that we want to foster in our students?
2. Where in the curriculum are students encouraged to develop the programme outcomes?
![Page 12: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/12.jpg)
Course Progression Maps
Goal – Create a visual representation of student progression through the curriculum to explore curriculum flow, balance of required core programme delivered courses, required and recommended electives, etc.
Data collected from: • Calendars• Course outlines• Curriculum committees
![Page 13: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/13.jpg)
Course Progression Maps
![Page 14: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/14.jpg)
Programme Outcomes Map
Goal: To match programme outcomes with individual courses that intentionally foster the development of selected outcomes.
Data collected from: • Faculty• Course outlines• Curriculum committees
![Page 15: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/15.jpg)
Survey Questions :•Which instructional methods do you use in this course?
•Which assessment approaches do students engage in for this course?
•For each listed Knowledge, Skill and Value, please indicate which, if any, you intentionally foster in this course? At what level of sophistication?
•For those indicated, please specify how /whether each KSV is taught and/or assessed in this course?
•How are the total marks available to students distributed over the course of the semester?
•Comments?
Course-by-course info:•Outcomes•Assessment•Learning methods
Course-by-course info:•Outcomes•Assessment•Learning methods
![Page 16: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/16.jpg)
Research Methods - Instructional Approaches
0
2
4
6
8
10
12
14
16
Methods
Fre
qu
ency
Research Methods
Lecture – 15Readings – 14Presentations – 7Research - 6
Lecture – 15Readings – 14Presentations – 7Research - 6
![Page 17: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/17.jpg)
Research Methods - Assessment
0
1
2
3
4
5
6
7
8
9
10
Res
earc
hM
etho
ds
Ass
esse
d
Gra
phic
s(M
aps,
Pla
ns,
Sch
emat
ics,
Ora
lP
rese
ntat
ion
(Gro
up)
Ora
lP
rese
ntat
ion
(Ind
ivid
ual)
Par
ticip
atio
n (I
n-cl
ass)
Pro
ject
(G
roup
)
Pro
ject
(Ind
ivid
ual)
Ski
llsD
emon
stra
tion
Tes
t/Q
uiz/
Exa
m(
> 2
5% o
f F
inal
Gra
de )
Tes
t/Q
uiz/
Exa
m(
? 25
% o
f F
inal
Gra
de )
Writ
ten
Ass
ignm
ent
( >
5 pa
ges
)
Writ
ten
Ass
ignm
ent
( ?
5 pa
ges
)
Method
Fre
qu
ency
Research Methods
Test/Quiz/Exams – 14Projects/Assignments – 13Presentations – 5Participation - 1
Test/Quiz/Exams – 14Projects/Assignments – 13Presentations – 5Participation - 1
![Page 18: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/18.jpg)
Case Study
• Tasks:– What would you recommend as the next
step
• Questions:– What activities and/or tools might you
use as a facilitator?– What best practices and/or principles
would you suggest as a facilitator?
![Page 19: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/19.jpg)
Key Questions
1. What are the programme outcomes that we want to foster in our students?
2. Where in the curriculum are students encouraged to develop the programme outcomes?
3. How do we know whether our programmes are successful?
![Page 20: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/20.jpg)
Programme Assessment
Programme Outcomes
ContentContent
Asse
ssme
nt
Asse
ssme
nt
Lea
rnin
g m
eth
od
sL
earn
ing
me
tho
ds
Effecti
ve?
Efficient?
Appropriate?
Effecti
ve?
Efficient?
Appropriate?
Effective? Efficient?
Appropriate?
Effective? Efficient?
Appropriate?
Effective?
Efficient?
Appropriate?
Effective?
Efficient?
Appropriate?
![Page 21: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/21.jpg)
Programme Assessment
• Student work – Tests, assignments, etc.• 360° consultations of stakeholders• External reviews, accreditations, etc.• Benchmarks, research, literature, etc.• Student reflection – (e)Portfolios, journals,
etc.• Analytics
![Page 22: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/22.jpg)
Level 1 Reactio
n
Level 2 Learnin
g
Four Levels of Evaluation
Level 4 Results
Level 3 Behavior
Kirkpatrick, D. (1994). Evaluating Training Programs: The Four Levels. San Francisco: Berrett-Koehler
![Page 23: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/23.jpg)
Level 1Reaction
Key Question: What was the student reaction to learning environment?
Timing: Usually done immediately or soon after the learning event(s)
Four Levels of Evaluation
Kirkpatrick, D. (1994). Evaluating Training Programs: The Four Levels. San Francisco: Berrett-Koehler
![Page 24: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/24.jpg)
Level 2 – Learning
Key Question: Did students achieve desired learning objective(s)?
Timing: Usually done immediately or soon after learning
Four Levels of Evaluation
Kirkpatrick, D. (1994). Evaluating Training Programs: The Four Levels. San Francisco: Berrett-Koehler
![Page 25: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/25.jpg)
Kirkpatrick, D. (1994). Evaluating Training Programs: The Four Levels. San Francisco: Berrett-Koehler
Level 3 Behavior
Key Question: Are newly acquired skills, knowledge, or attitude used by learner after learning event is completed?
Timing: Usually done 1-3 months after learning
Four Levels of Evaluation
![Page 26: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/26.jpg)
Level 4 - Results
Key Question: Did students achieve desired outcomes of program of study?
Timing: Usually done 3 months – 2 years after learning experience
Four Levels of Evaluation
Kirkpatrick, D. (1994). Evaluating Training Programs: The Four Levels. San Francisco: Berrett-Koehler
![Page 27: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/27.jpg)
Participants Activity How often Questions
Current Students
Focus Groups
Annual
•What knowledge, skills and values do you think are most important to graduates of the programme? (compare with the current outcomes)
•Describe your most enjoyable learning experiences at Guelph to date.
•Comments on other aspects of your Guelph experience (e.g. awards, academic support)?
•What would you change about the curriculum?
•Please suggest changes to help us improve the program: what would you add/drop from the curriculum? Other changes?
•What advice would you give to an incoming student?
Alumni/ Employers
Focus Groups Bi-annual What knowledge, skills and values do you look for when hiring?
How well do our graduates meet those KSAs
What kinds of work would someone with an undergraduate degree be doing in your organization?
What advise would you give a student coming into this program regarding their educational options?
Where do you see new employees in 5 years? What are their opportunities for advancement?
…
Assessment Plan Sample
![Page 28: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/28.jpg)
Participants Activity When Questions
Secondary Documents
Previous Review,
Other programs
5 years To provide an overview of “where we are” in relation to experiential insights gained from faculty and students.
Faculty Web survey followed by
faculty retreat
Every 2 years Web survey – Solicit feedback on current programme outcomes by faculty
Retreat – review results of survey Based on faculty perspectives, develop a list of programme (a) strengths (b) weaknesses (c) opportunities (d) limitations? Compare faculty SWOT with the other stakeholder SWOT Develop an action plan
Assessment Plan Sample (cont’d)
![Page 29: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/29.jpg)
• Data-informed• Faculty-driven• Student-engaged• Stakeholder-informed• Culture- & context-specific• Rigorous & authentic• Continuous improvement of sustainable practices• Resourced & recognized
Recommended Practices
A Guide to Developing and Assessing Learning Outcomes at the University of Guelph - http://www.uoguelph.ca/vpacademic/avpa/pdf/LearningOutcomes.pdf
![Page 30: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/30.jpg)
• Refining the blend of people, processes & resources
• Transition requires investment• Keep momentum• Continuous improvement is at least as
important as ‘reporting’• Mistakes will happen
Keep in Sight
![Page 31: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/31.jpg)
Reflective Questions
• How can you use what you have learned today in curriculum development initiatives in which you are involved?
• What does not apply? How come?• What else do you need to learn to further develop
your curriculum development facilitation skills?
![Page 32: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/32.jpg)
![Page 33: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/33.jpg)
Curriculum Development FacilitationBest Practices/Principles
• Engaged an unbiased facilitator who can focus on process and keeping things moving
•
![Page 34: Facilitating Curriculum Development: Principles, Practices and Tools Peter Wolf April 2013](https://reader031.vdocuments.us/reader031/viewer/2022032105/56649d945503460f94a7b460/html5/thumbnails/34.jpg)
Curriculum Development Facilitation Tools / Activities
• VUE – Visual Understanding Environment – Progression Mapping software – http://vue.tufts.edu/
• Donald Kirkpatrick – 4 Levels of Evaluation – http://www.kirkpatrickpartners.com/
OurPhilosophy/tabid/66/Default.aspx