designing meaningful institutional assessment plans: taking the big picture view

21
Catherine Wehlburg, Ph.D. Assistant Provost for Institutional Effectiveness Texas Christian University TAMU Assessment Conference 2011 Designing Meaningful Institutional Assessment Plans: Taking the Big Picture View

Upload: tocho

Post on 23-Feb-2016

25 views

Category:

Documents


0 download

DESCRIPTION

Designing Meaningful Institutional Assessment Plans: Taking the Big Picture View. Catherine Wehlburg, Ph.D . Assistant Provost for Institutional Effectiveness Texas Christian University TAMU Assessment Conference 2011. Rationale For This Workshop. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

Catherine Wehlburg, Ph.D.Assistant Provost for Institutional Effectiveness

Texas Christian University

TAMU Assessment Conference 2011

Designing Meaningful Institutional Assessment

Plans: Taking the Big Picture View

Page 2: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

Institutions with accreditation now have access to a great deal of information about developing assessment plans and many fine examples of general education assessments, academic department assessment plans, and a plethora of student affairs and student support assessment plans. But many institutions are lacking in the overall institutional level assessment planning that goes beyond general education.

Rationale For This Workshop

Page 3: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

The Five Minute University

Page 4: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

XXX University is a multi-campus public university providing innovative undergraduate and graduate education that contributes to the development of society and the individual. The University actively facilitates learning through the preservation, discovery, synthesis, and dissemination of knowledge.

XXX University is dedicated to the discovery, development, communication, and application of knowledge in a wide range of academic and professional fields. Its mission of providing the highest quality undergraduate and graduate programs is inseparable from its mission of developing new understandings through research and creativity. It prepares students to assume roles in leadership, responsibility, and service to society.

Mission Statements

Page 5: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

The mission of XXX University is to educate its students and cultivate their capacity for life-long learning, to foster independent and original research, and to bring the benefits of discovery to the world.

The XXX College encourages students to respect ideas and their free expression, and to rejoice in discovery and in critical thought; to pursue excellence in a spirit of productive cooperation; and to assume responsibility for the consequences of personal actions. XXX seeks to identify and to remove restraints on students' full participation, so that individuals may explore their capabilities and interests and may develop their full intellectual and human potential. Education at XXX should liberate students to explore, to create, to challenge, and to lead.

Mission Statements

Page 6: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

To provide a diverse and vibrant student body access to high quality educational opportunities that include a student-centered academic environment combining innovative pedagogy with experiential learning that will prepare students for professional success, responsible citizenship, life-long learning, and significant contributions to a rapidly changing world.

Mission of “Great State University”

Page 7: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

General statements about knowledge, skills, attitudes and values expected in graduates of the program.

Broad based statements of purposeOften, these are not measurableShould cover all aspects of the mission

statementUsually written to align with the holistic “big

picture” of the mission.

Writing Goals

Page 8: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

To provide a diverse and vibrant student body access to high quality educational opportunities that

include a student-centered academic environment combining innovative pedagogy with experiential

learning that will prepare students for professional success, responsible citizenship, life-long learning, and significant contributions to a rapidly changing

world.Write 3-5 goals that you see within this mission

statement (individually or with a partner).Compare your goals to your table’s goals. Identify

your top three goals to share with the larger group

Writing Goals – Group Work

Page 9: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

What Were Your Goals?

Page 10: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

Learning outcomes are clear, concise statements that describe how students can demonstrate their mastery of program goals

Outcomes are more specific than goals, and there are usually multiple learning outcomes for each goal

What are Learning Outcomes ?

Page 11: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

Knowledge outcomes:Major or discipline contentModes of inquiry

General Education or Core Curriculum outcomes Skills outcomes:

Those required for effective practice in the discipline or in future employment

Ability to work with othersListening skillsTeamwork or leadership

Attitudes and valuesPersonalSocialEthical

Areas of Learning Outcomes

Page 12: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

Student Learning Behavior-Knowledge, skill, or attitude to be gained

The method of assessment- conditions of performance

Criteria for achievement- the levels of acceptable performance

3 Components to a Learning Outcome

Page 13: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

Creating -Generating new ideas, products, or ways of viewing things

Evaluating –Drawing a conclusion or deciding upon a course of action

Analysing -Breaking information into parts to explore understandings and relationships

Applying -Using information in another familiar situation

Understanding -Explaining ideas or concepts

Remembering -Recalling information

Bloom’s Taxonomy - Revised

Page 14: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

The student will be able to (specific student behavior)  ____________________________________________________ as measured by (conditions of performance – could

include time frame)  ___________________________________________________ at the ______________________________________ level

(performance criteria).

Template for Writing SLOs

Page 15: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

Words and Phrases to Avoid in SLOs

Appreciate Be comfortable with

Believe Enjoy

Grasp the significance of Have faith in Internalize

Know Learn

Recognize Understand

Page 16: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

Students will name the three types of rock in order to differentiate among the three.

Students will correctly compare and contrast the characteristics of the three types of rocks on a final exam essay question in order to differentiate among the three.

Discover that Great State University offers a welcoming and helpful environment which can fulfill their educational, cultural and social needs in order to recognize the university’s role in lifelong learning.

Outcomes – Well Written?

Page 17: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

Meaningful Ways To MeasureRubrics (a scoring strategy or tool)PortfoliosPre/Post TestingEmbedded projects or papersItems within an examCapstone ExperiencesAlumni Surveys (indirect measure)Internship Evaluation (indirect measure)Employer Survey (indirect measure)Others?

Page 18: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

How will your data be shared? Who “owns” data?Create a collaborative system – data can

belong to everyone.Regularly schedule “data sharing” events.

Use the Results to Improve or Enhance!

Page 19: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

The outcomes must be understood by all (and in the same way!)

Assessment is as much about teaching and learning as it is about accountability

Faculty and staff must work together to develop institutional level goals and outcomes

Institution-level support is necessary to create usable and sustainable program and university-wide assessment plans

We must assess because learning matters most!

Lessons Learned

Page 20: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

Our students should learn more than “supply and demand”

We want our students to think critically, read, and question – so we must build this into our assessment plans

Institutional level assessment must involve the entire campus – faculty, student affairs staff, administration, etc.

College graduates should have attended more than a five minute university!!!

What Would Father Guido Say?

Page 21: Designing Meaningful Institutional Assessment Plans:  Taking the Big Picture View

Questions?