preparing outcomes assessments of students’ learning in their academic programs sponsored by...
TRANSCRIPT
![Page 1: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/1.jpg)
PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC
PROGRAMS
Sponsored by
Office of the PresidentOffice of the Provost
Office of Strategic PlanningTeaching, Learning, and Technology Center
![Page 2: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/2.jpg)
OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING
Two boys are walking down the street. The first boy says, “I’ve been really busy this summer. I’ve been teaching my dog to talk.”
His friend responds, “Wow! I can’t wait to have a conversation with your dog.”
The first boy shakes his head. “I said I’ve been teaching him. I didn’t say he learned anything.”
M.J. Allen
Assessing Academic Programs in
Higher Education
![Page 3: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/3.jpg)
OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING
PURPOSES• To develop program specific
assessment plans for academic programs.
• To integrate program assessment into the ongoing, annual planning and assessment reporting process.
![Page 4: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/4.jpg)
PROVOST WILLIAM MARCY
Significance of Academic Program Assessment
![Page 5: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/5.jpg)
Presentation Overview
• Program-level outcomes and assessment
• Key concepts related to outcomes and assessment
• Course-level outcomes and assessment (reflected in a syllabus)
• Questions and Discussion
![Page 6: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/6.jpg)
Learning Outcomes and Assessment
• Texas Tech University is striving to incorporate expected learning outcomes and methods for assessing those learning outcomes into the courses and degree programs offered at the institution
![Page 7: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/7.jpg)
Program-Level Learning Outcomes and Assessment
• The term “program-level” refers to learning outcomes and assessment methods related to a degree program
• Program-level assessment investigates what the students are learning in their degree programs
• Program-level learning outcomes and assessment are reflected in the Strategic Plan
![Page 8: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/8.jpg)
Program Purpose
• The first step in writing and assessing program-level learning outcomes is determining the purpose of the degree program
• It is important to engage faculty in this (and all subsequent) steps in the process
![Page 9: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/9.jpg)
Program Purpose
Questions to ask to help determine the course purpose include:
• What role does this program play in the department or college?
• What is unique or special about this academic area/degree program?
• What will the students “do” with their degrees?
![Page 10: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/10.jpg)
Expected Learning Outcomes
Once the program’s purpose has been established, specific learning outcomes can be developed
A program-level expected learning outcome is a formal statement of what the program’s faculty expects students to learn in a particular degree program
![Page 11: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/11.jpg)
Expected Learning Outcomes
Expected learning outcomes define:
• What faculty expect students to know at the end of the degree program
AND• What faculty expect students to be able to
do at the end of the degree program
![Page 12: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/12.jpg)
Possible Example for aHistory Degree Program
Recipients of degrees in this program will be able to:
• Identify and describe the significant people, events, ideas and developments in history
![Page 13: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/13.jpg)
Program-level Assessment
• Once the learning outcomes for a degree have been established, a variety of methods are used to assess if the students’ learning matches those expected outcomes.
![Page 14: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/14.jpg)
Assessing Expected Learning Outcomes
Assessment of Expected Learning Outcomes can be defined as the process of investigating:
1. what students are learning and
2. how well they’re learning it.
![Page 15: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/15.jpg)
Assessment Plans
• Departments should develop assessment plans that outline how and when they will be investigating how well both the current students and students who have graduated have learned/mastered the program-level learning outcomes
![Page 16: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/16.jpg)
How to Assess Program-Level Learning Outcomes
Methods to Assess Current Students’ Learning
• Capstone courses• Review of senior projects• Focus groups• Students’ performance on
comprehensive exams
![Page 17: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/17.jpg)
How to Assess Program-level Learning Outcomes
Methods to Assess Graduated Students’ Learning
• Graduate follow-up surveys
• Performance on licensure exams
• Job placement data
• Exit interview/surveys
![Page 18: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/18.jpg)
Course-Level Learning Outcomes and Assessment
• The term “course-level” refers to outcomes and assessments methods related to courses that are offered at Texas Tech
• Course-level learning outcomes and assessment methods are reflected in the course syllabus
![Page 19: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/19.jpg)
Course-Level Learning Outcomes and Assessment
• The Teaching, Learning, and Technology Center (TLTC) has developed some resources to assist faculty with creating expected learning outcomes statements and assessment methods
![Page 20: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/20.jpg)
Questions and Discussion
![Page 21: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/21.jpg)
What issues do you expect to encounter as you work to develop
program assessment plans?
![Page 22: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/22.jpg)
One question to anticipate:Who uses the program assessment
reports?
Two questions to answer the above:
• Who is responsible for the quality of the department’s academic programs?
• Who receives the reports when they are submitted?
![Page 23: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/23.jpg)
This morning’s task:
• To examine selected drafts of assessment plans
• To develop program purpose statements
• To identify expected outcomes
![Page 24: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/24.jpg)
TEAM (table) WORK
• Focus first on the purpose statement for the degree program
• Then develop statements of expected outcomes• Work with others at your tables• Reeve, McCourt, and Paton are facilitators (if
needed)
![Page 25: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/25.jpg)
Morning SessionWrap-up
QUESTIONS AND DISCUSSIONS
LUNCH!
![Page 26: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/26.jpg)
TEAM WORK CONTINUES
Afternoon tasks:
• Assessment Audit Worksheet (brainstorming)
• Identifying methods of assessment for each learning outcome
![Page 27: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/27.jpg)
Late afternoon wrap-up
Strategies for developing assessment plans:• Engage the faculty• Begin with discussions at first faculty
meetings of the year• Use committees to draft materials and share
with all faculty• Use available resources (TLTC and Office of
Strategic Planning – see websites)• Create a timeline to meet the December 15
deadline
![Page 28: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/28.jpg)
Late afternoon wrap-up
Strategic Planning and Program Assessment• Two related but different processes
– SP – usually long term goals with benchmarks, objectives and strategies – addresses all aspects of department
– PA – continuous (incremental) program improvement based on performance against expected outcomes
• Integration of the planning and reporting – one common reporting process and one cycle
![Page 29: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/29.jpg)
Late afternoon wrap-up
FUTURE WORKSHOPS
September 21-22 – Dr. Doug Eder, Director of Undergraduate Assessment
and Program Review, SIU-E.
November 11 – Assessment Workshop – Preparing for submission of Assessment
Plans
![Page 30: PREPARING OUTCOMES ASSESSMENTS OF STUDENTS’ LEARNING IN THEIR ACADEMIC PROGRAMS Sponsored by Office of the President Office of the Provost Office of Strategic](https://reader036.vdocuments.us/reader036/viewer/2022062519/5697c02d1a28abf838cd9e7a/html5/thumbnails/30.jpg)
THANK YOU!