assessment planning for academic degree programs€¦ · Øsupports academic planning, curricular...
TRANSCRIPT
![Page 1: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/1.jpg)
Assessment Planning for Academic Degree Programs
Monday, April 4, 201612:00noon – 2:00pm
Union South
Mo Bischof, Associate Vice Provost, Provost OfficeLaura Grossenbacher, Director of Undergraduate Program Review,
College of EngineeringRegina Lowery, Assessment Coordinator, Provost Office
http://provost.wisc.edu/assessment/1
![Page 2: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/2.jpg)
Session Overview
1. Welcome and Introductions2. Context and Overview3. Assessment Planning: Framework and Definitions 4. Plan Development: Questions, Discussion and Drafting
5. Resources and Support
2
![Page 3: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/3.jpg)
Today’s Focus
Ø Getting started; refining your assessment plan.
Ø Review/discuss drafts, build next steps.Particularly the “how” component of plan
Ø Simple, smart, meaningful and evolving.
3
![Page 4: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/4.jpg)
Context and Overview: Nationally
Ø Focus on student learning in higher education has shifted — “value question”
Ø Shift from inputs (delivering content) to outputs (outcomes/learning impact)
Ø Emerging pedagogies/technology — enhanced learner-centered approaches
Ø Shift in external accreditation requirements
4
![Page 5: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/5.jpg)
Context and Overview: UW-MadisonØ Assessing learning is an integrated, ongoing
component of academic life ---not new!Ø Supports academic planning, curricular & co-curricular
development
Ø Ensures the quality of our academic programs and supports program review
Ø Aligns with the University Assessment Plan endorsed by UCAAA & UAPC, 2015Ø Higher Learning Commission (HLC) criteria for reaccreditation
Ø Telling YOUR story
5
![Page 6: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/6.jpg)
Elements of Assessment Planning (WWHSW)
What – What are students expected to learn?
Where – Where in the curriculum are students expected to learn and apply the knowledge and skills specified as the learning goals?
How – How do program faculty know (what is the evidence) that students are learning what they expect them to learn?
So What – After reviewing the assessment activity findings (evidence), determine if students are meeting the expectations. Validate that expectations are being met or consider ways to improve.
6
![Page 7: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/7.jpg)
Assessment Cycle (WWHSW)
Academic Program
Assessment(WWHSW)
WHATDevelop/Revise Learning Goals
WHEREMap Learning Goals
to Curriculum & Student Experiences
HOWDevelop & Conduct
Assessments (metrics, measures)
SO WHATInterpret/Report and Use Findings
7
![Page 8: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/8.jpg)
Key terms defined
Direct measures: regular assessments that measure students’ demonstrated learning (artifacts) through homework questions, writing samples, exams, final papers, projects, presentations, portfolios, etc.
Indirect measures: perceived learning gathered through self-reports (course evaluations, exit surveys, employee survey, focus groups, exit interviews, or alumni surveys)
Formative assessments: gathering feedback at intervals within a process (course/program) -- feeds improvement in ‘real time’
Summative assessments: evaluating student learning at the end of a unit (final exams, papers, performances/certification or board exams/post-grad surveys) to compare to an established standard or benchmark
8
![Page 9: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/9.jpg)
Getting started.What: Learning Goals
9
![Page 10: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/10.jpg)
Where: Curricular Review (mapping)
*For%use%only%to%illustrate%curriculum%mapping.%%Learning%outcomes%and%courses%listed%are%not%official%for%the%major.%
Example(Curriculum(Map(!
*EXAMPLE:(Curriculum(Map(for(B.A.(in(Graphic(Design((
*EXAMPLE:(Program?level(Student(Learning(Goals(
Stud
ents(will(dem
onstrate(th
eir(
unde
rstand
ing(of(m
ajor(th
eorie
s,(
approa
ches,(con
cepts,(and
(current(and
(classic
al(re
search(find
ings(in(th
e(area(of(
concen
tration.(
Stud
ents(will(app
ropriately(utilize(the(
techniqu
es,(skills(and
(mod
ern(tools(
necessary(for(p
ractice.(
Stud
ents(will(evaluate(eviden
ce(to
(de
term
ine(an
d(im
plem
ent(b
est(
practice.(
Stud
ents(will(com
mun
icate(effectively(
throug
h(written(repo
rts,(oral(
presen
tatio
n(an
d(discussio
n.(
*List(o
f(cou
rses(re
quire
d(to(
complete(the(de
gree
(program
( 346(Typography(and(Communication(Design( x( x( x( (
356(Print(Production(for(Graphic(Designers( x( x( x( x(
438(Cultural(Context(of(Graphic(Design(and(Typography( x( ( x( (
458(Graphic(Design(for(Branding(and(Identity( x( ( x( x(
465(Graphic(Design(for(Packaging( ( ( x( x(
546(Graphic(Design(for(Publication( x( x( x( x(
556(Graphic(Design(for(Interactive(Media( x( x( x( x(
565(Typeface(Design( x( x( x( x(
656(Design(Portfolio(and(Professional(Practice( x( x( x( x(
!10
![Page 11: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/11.jpg)
How: What are you already doing? Low hanging fruit! Start with indirect measures…
Ø Graduating seniors or graduate student exit survey
Ø Student focus groups
Ø Alumni surveys
Ø Employee or internship site surveys
Ø Course evaluations – student feedback about their learning
11
![Page 12: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/12.jpg)
Among other indirect measures, we use Alumni Surveys about once every six years.
12
![Page 13: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/13.jpg)
An easy indirect measure: Add course evaluation questions that ask about student learning gains:
How well did this course prepare you to give formal technical presentations?
How well did this course help you to understand ethical responsibilities in engineering?
The UW-Madison Program Learning Assessment and Course Evaluation (PLACE/AEFIS) suite of tools makes adding questions to existing course evaluations relatively easy.
13
![Page 14: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/14.jpg)
So What? After reviewing the assessment activity findings (evidence), determine if students are meeting the expectations. Validate that expectations are being met or consider ways to adjust/improve.
Remember: Assessment without using the data is just a meaningless exercise: take the time you need to analyze the data and think about where your program could do continuous improvement.
14
![Page 15: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/15.jpg)
A Sustainable Assessment Plan: Hints
1. Have a regular data collection plan/3-5 year cycle. Year 1 - administer senior exit surveyYear 2 - review embedded question responses from
student course evaluationsYear 3 – review past three years’ senior theses using a rubric
(direct measure)Year 4…
Repeat/revise.
***Plan time and resources for analysis/reporting.
2. Align with other departmental priorities or activities (program review, curriculum review, accreditation visit, course evaluation, alumni visits)
15
![Page 16: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/16.jpg)
Assessment Planning, REMEMBER:
DOs: Keep it simple, smart, meaningful, evolving
DON’Ts: Don’t do it ALL, all the time!!!
16
Remember that the assessment process is iterative.
![Page 17: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/17.jpg)
Questions?
Table discussions:* start with your program learning goals* what do you need to get to the next step(s)? * work together at table; resource folks to help
What do you need to know more about?
17
![Page 18: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/18.jpg)
Program Assessment Planning Toolshttp://provost.wisc.edu/assessment/
Program Learning Goals: See website
Templates and Examples:• Undergraduate Degree Program Template• Graduate Degree Program Template
Tools for each planning stage
Examples from peer institutions, UW-Madison
18
![Page 19: Assessment Planning for Academic Degree Programs€¦ · ØSupports academic planning, curricular & co-curricular development ... • Undergraduate Degree Program Template • Graduate](https://reader034.vdocuments.us/reader034/viewer/2022050501/5f9370e81303d854ac7a6439/html5/thumbnails/19.jpg)
Key Resources and SupportOffice of the Provost: • Mo Bischof, Associate Vice Provost, [email protected]• Regina Lowery, Assessment Coordinator
School/College academic associate deans - University Council on Academic Affairs and Assessment (UCAAA)
Graduate School colleagues
Division of Continuing Studies colleagues
19