Quality Assessment for Institutional Effectiveness

Dr. Gino Pasquariello2011 Annual TRACS Conference

Session Overview

The Purpose of this workshop is to provide you with a clear pathway to institutional assessment that results in Better Data Collection and Analysis Better Planning Better Reporting Provides you with a professionally developed system

Topics will cover The steps of an effective assessment cycle The characteristics of a quality assessment

instruments Maximizing the effectiveness of assessment data and

findings

Institutional Assessment Basics Is there a Documented and Approved

Assessment Plan? Include instruments and schedules Department and Program reviews Assess Student and Program Learning Outcomes

Is the Assessment Plan Implemented? Evidence of data collection and analysis Evidence of dissemination and reporting

Is the Assessment Data Utilized? Reviews Planning Budgeting

A Culture of Assessment

In Theological Education, we are on the cusp of a revolution, but it requires a shift toward a Culture of Assessment!

 80% of assumptions are not substantiated by data (anecdotal, gut, emotion, personal preference, etc..)

 Improve Alignment between Assessment, Strategic Planning, and Budgeting

Assessment

PlanningBudgeting

Ensuring Assessment Alignment

Alignment is Critical! What are you Assessing? Why are you Assessing it? How are you Assessing it?

Assessme

nt

Evaluation

& Reporting

Ensuring Assessment Alignment

Alignment is Critical! Institutional Mission and Objectives Institutional Effectiveness Program and Student Learning

Outcomes Accreditation Standards Institutional Benchmarks External Agencies Best Practices

Providing Assessment Reporting

Executive Administration Departments Accreditation

Annual Operational Report Quality Compliance Review (QCR) Self-Study Documentation

Transparency, Reality, ROI

The Need for Core Institutional Assessment Instruments

A Complete Suite of Core Institutional Assessment Instruments Entering Student Inventory (ESI) Seminary Experience Inventory (SEI) Graduating Student Inventory (GSI) Alumni Inventory (AI) Faculty Satisfaction Inventory (FSI)

Maximizing the Effectiveness of the Core Instruments

Three Key Areas Quality of Instruments (Design and

Development) Timeliness of Reporting (Analysis and

Dissemination) Implementation of Findings (Closing the

Loop)

Maximizing Effectiveness

Quality of Instruments Alignment Validity and Reliability Filtering and Analysis Assurance of Confidentiality

Maximizing Effectiveness

Timeliness of Reporting Year-round, documented, and systematic

cycle of assessment Time to Reporting▪ Review▪ Planning▪ Budgeting

Maximizing Effectiveness

Implementation of Findings Useful Formatting Summary information Strategic Recommendations Departmental Action and Improvement Developing SWOT Analysis Data

Core Institutional Assessment Instruments

Core Online Assessment Instruments Entering Student Inventory (ESI) Seminary Experience Inventory (SEI) Graduating Student Inventory (GSI) Alumni Inventory (AI) Faculty Satisfaction Inventory (FSI)

Core Institutional Assessment Instruments

Professional Features Provide an Annual Documented System of

Administration, Analysis and Reporting of Institutional Assessment

Designed according to higher education Best Practices and the unique context of the Christian education environment (Validity and Reliability)

Alignment with Accreditation Reporting Provides Timely reporting of assessment findings Facilitates data-driven decision-making for Strategic

Planning Provides Benchmarking Data for Institutional

Effectiveness

Participating Schools

Participating Schools Include: Bethel Theological Seminary Phoenix Seminary Denver Seminary Multnomah University Ashland Seminary Columbia University

The Goal is to provide TRACS institutions with these assessment instruments and to also provide all-schools data for benchmarking and reporting

Quality Assessment for Institutional Effectiveness

Blessings and Thanks!

Contact Information:

Dr. Gino PasquarielloDirector of Institutional ResearchSouthern California SeminaryEl Cajon, CA 92019Office: 619-201-8965Cell: 619-804-0990gpasquariello@socalsem.edu