comprehensive pharmacy evaluation and...

1

6/4/08 3/11/09 (revised based on full review) 4/8/09 (updated) 7/23/13 (updated) 9/18/15 (updated based SP and standards review)

Comprehensive Pharmacy Evaluation and Assessment Plan

EACPHS Pharmacy Program

Preamble to our CPAEP

Measuring the success of the overall pharmacy program requires assessment and evaluation

based on a set of parameters. This Plan provides a set of parameters to conduct this process in an

ongoing fashion. The process outlined in this Plan is intended to not only provide a measure of

success but also to serve as one step in the process of continuing development and improvement

of the overall pharmacy program.

How was this plan created?

The parameters incorporated in this Plan are based on the established College, Department, and

Program missions and strategic plans and on the standards established by the Accreditation

Council for Pharmacy Education. Numeric benchmarks have been determined based on

prespecified academic standards, pharmacy program norms or expectations, and stakeholder

feedback.

How do we obtain and review data for this plan?

Data is obtained from a variety of sources including curricular documents, surveys, student

performance data, focus groups, and committee reports. Items incorporated in this plan are to be

reviewed at regular intervals by the Assessment Committee and also incorporates all routine

activities included on the on the Pharmacy Program Strategic Plan.

How do we communicate findings and assessment of data in our CPAEP?

The structure of this Plan is intended to facilitate both input from and output to the identified

responsible Committees and Leadership delineated in the Plan. Communication with

stakeholders and key leadership is imperative to the effectiveness of this plan and consideration

must be given to the dynamic nature of academic pharmacy. Communication regarding

performance on domains of our CPAEP is also relayed to other internal and external stakeholders

through meetings, newsletters, and our Assessment webpage.

Our commitment to the quality of the CPAEP:

Inherent in this Plan is the expectation of ongoing review and revision to provide a meaningful

assessment and evaluation. Continual strengthening of the Plan encourages and requires faculty

input to the Pharmacy Assessment Committee.

2


Domain Responsible

Person

Assessment Item Assessment

Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Academic

Performance &

Progression

Chair, CAPP Class Standing Student GPA/class

rankings

Metric: Create listing

CPHS &

Depts’Missions

19 Annual

(July)

Academic

Performance &

Progression

Chair, CAPP Progression Grad. Rate-on time -

85%

Probation rate – 20%

Delayed rate – 15%

Remediation rate –

90%

Exclusion rate – 3%

Withdraw Rate – 5%

Grad Rate Overall -

95%

CPHS &

Depts’Missions

19 Annual

(July)

Admissions and

Recruitment

Chair,

Admissions

Committee

Admissions

Process

AACP Student

Survey**

CPHS & Depts’

Missions

16 Annual

(September)

Admissions and

Recruitment

Chair,

Admissions

Committee

Admissions

Process

Faculty Admission

Process Survey

Metric:

>20% change in

weighting of

admission parameter

CPHS & Depts’

Missions

16 Annual

(June)

3


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Admissions and

Recruitment

Chair,

Admissions

Committee

Admissions

Process

Applicant Interview

Survey

Metric:

>5% marginal/poor

(Q-11)

CPHS & Depts’

Missions

16 Annual

(April)

Admissions and

Recruitment

Chair,

Admissions

Committee

Applicant pool

Quantity and

Quality

Number of Applicants

meeting minimum

requirements

Metric: <200

GPA; PCAT Composite;

Interview Score

Metric: ↓ in any by

1.5 SD from previous 3

yr average

College, Program

Mission & SP

Critical issue 1

16 Annual

(May - prelim)

(October – final)

4


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Admissions and

Recruitment

Chair,

Admissions

Committee

Collaborative

Arrangement

WSU-Health ProStart

Oakland University

Report

Metric:

Number of students

entering Pharm.D.

Program

Metric:

Progression record

Metric: 100% on-time

graduation

College, Program

Mission & SP

16 Annual

(July)

Admissions and

Recruitment

Chair,

Admissions

Committee

Quality of

admitted class

(Progression from

CAPP)

Grad. Rate-on time -

85%




90%



Grad. Rate-overall –

95%

College, Program

Mission & SP

17 Annual

(July)

5


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Alumni -

Pharmacy

Associate

Dean

Pharmacy Alumni

Achievement

Honors/Awards

Metric: Report

Scholarly Activity

Metric: Report

Pharmacy

Organization

Leadership

Participation

Metric:

Practice Positions

Metric:

College, Program

Mission & SP

Critical issue 5

7, 8, 18,

19, 20

Annual

(November)

Alumni -

Pharmacy

Associate

Dean

Pharmacy Alumni

Contact

Pharmacy Alumni

Contact Listing

Metric:

College, Program

Mission & SP

Critical issue 5

7, 8, 18,

19, 20

Annual

(November)

6


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Alumni -

Pharmacy

Associate

Dean

Pharmacy Alumni

Participation

AACP Alumni Survey

Metric: 33%

Preceptor

Participation

Metric:

Alumni Association

Membership

Metric:

Alumni Affiliate Board

Participation:

Metric:

WSU CE Program

Participation:

Metric: Report on #

alumni, graduation

year, degree

College, Program

Mission & SP

Critical issue 5

7, 8, 18,

19, 20

Annual

(June &

November)

Assessment Chair,

Assessment

Committee

AACP Surveys Analysis Report on

AACP Surveys

Metric:

Analysis Reports

completed

Follow-up process

completed

24, 25 Annual

(September)

7


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Assessment Chair,

Assessment

Committee

Comprehensive

Pharmacy

Assessment and

Evaluation Plan

Tool Inventory

Metric:

95% of planned

assessments

completed

AACP Student &

Faculty

Surveys*

24, 25 Annual Plan

review and

revision

Ongoing review of

assessment items

in the Plan

Awards & Honors Chair, Awards

and Honors

Committee

Student

scholarships/awar

ds presented

Report – Listing

Metrics

#internal

awards/amount

categorize awards

#students applied by

class

#awarded (100%)

#external awards

College, Program

Mission & SP

Critical issue 5

14 Annual

(May)

Curriculum Chair,

Curriculum

Committee

Curricular Content AACP Student, Faculty

and Preceptor

Surveys**

College, Program

Mission & SP

1-4, 10,

11, 12, 13

Annual

(September)

8


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Curriculum Chair,

Curriculum

Committee

Curricular Content Curricular Mapping

(ACPE 2016 Appendix

I)

Metric: Appendix I

Items mapped to

courses – 100%

College, Program

Mission & SP

1-4, 10,

11, 12, 13

Annual

(October)

Curriculum Chair,

Curriculum

Committee

Curricular Content Course Review

Metric: 100%

College, Program

Mission & SP

1-4, 10,

11, 12, 13

Annual

(October)

Curriculum PEC Curricular

Development,

Delivery, and

Improvement

AACP Surveys** College, Program

Mission & SP

Critical issue 1

1-4, 10,

11, 12, 13,

24, 25

Annual

(September)

9


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Curriculum Chair,

Curriculum

Committee

Curriculum

Effectiveness

Student self-

assessment- Program

ABOs -Rubric

Metric 1 ≥ 10% of

students evaluate

themselves as

Beginning at the end

of the P4 year

Metric 2. decrease of

≥ 25% of P4 students

who evaluate

themselves as being

Accomplished

compared to the

previous year’s

students.

Metric 3 100% student

participation

College, Program

Mission & SP

1-4, 10,

11, 12, 13,

24, 25

Annual

(September)

Curriculum Chair,

Curriculum

Committee

Curriculum

Effectiveness

AACP Student, Faculty

and Preceptor

Surveys**

Exit Survey*

College, Program

Mission & SP

Critical issue 1

1-4, 10,

11, 12, 13,

24, 25

Annual

(September)

10


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Curriculum Chair,

Curriculum

Committee

Curriculum

Effectiveness

NAPLEX Exam/ MJPE

Exam

Metric: pass rate <

95%

College, Program

Mission & SP

1-4, 10,

11, 12, 13,

24, 25

Annual

(October)

Curriculum Chair,

Curriculum

Committee

Curriculum

Effectiveness

Faculty Listing of ABOs

in course

Metric: 100% of syllabi

include ABOs

addressed in course

College, Program

Mission & SP

1-4, 10,

11, 12, 13

Annual

(June)

Curriculum Chair,

Curriculum

Committee

Curriculum

Effectiveness

Course Specific

Assessments related

to: Communication,

Problem Solving,

Critical Thinking,

Cultural

sensitivity/awareness

Metric: TBD

College, Program

Mission & SP

3, 10, 25 Annual (June)

Curriculum Director

Experiential

Education

Experiential

Education

AACP Student, Faculty

and Preceptor

Surveys**

College, Program

Mission & SP

12, 13, 24,

25

Annual

(September)

11


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Curriculum Director

Experiential

Education

Experiential

Education

Aggregate Patient

Demographic and

Disease data

Metric: TBD

College, Program

Mission & SP

12, 13, 24,

25

Annual

(June)

Curriculum Director

Experiential

Education

Experiential

Education

Preceptor

Development

Preceptor

Development Series

Metric: 100%

compliance with

requirement

College, Program

Mission & SP

20, 22 Annual

(April)

Curriculum Director

Experiential

Education

Experiential

Education

Preceptor/Experie

nce

Assessment

Student Evaluation of

Preceptors/Experienc

e

Metric: survey item ≤

2 from ≥2

student/academic

year/preceptor

Metric: ≥2 student

failing/academic

year/preceptor

College, Program

Mission & SP

12, 13, 20,

22

Annual

(June)

12


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Curriculum Chair,

Curriculum

Committee

and Director

Experiential

Education

Interprofessional

Education

Assessments (pre-

APPE, IPPE, APPE)

TBD College, Program

Mission & SP

3, 11-13,

25

Curriculum PEC Professionalism AACP Student, Faculty

and Preceptor

Surveys**

College, Program

Mission & SP

4, 10, 24 Annual

(September)

Curriculum CAPP

Committee

Professionalism Honor Code

Metric: 100%

adherence

College, Program

Mission & SP

4, 10 Annual

(May)

Curriculum PEC Professionalism Student involvement

in professional

organizations

Metric: 100%

participation in

minimum of 1

organization

College, Program

Mission & SP

3, 4,12 Annual

(May)

13


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Director,

Experiential

Education

Professionalism Experiential self-

evaluations

Metric: 100%

completion in

portfolio

Professional meeting

attendance

Metric:

100%attendance

College, Program

Mission & SP

10, 12, 13 Annual

(June)

Curriculum Chair,

Curriculum

Committee

Professionalism Personal and

professional

development tools

Metric TBD

College, Program

Mission & SP

4, 10, 25

Curriculum Chair,

Curriculum

Committee

Student Learning AACP Student, Faculty

and Preceptor

Surveys**

College, Program

Mission & SP

Critical issue 1

10, 20, 25 Annual

(September)

Curriculum Chair,

Curriculum

Committee

Student Learning Pass rates for

individual courses

Metric: >97%

College, Program

Mission & SP

10, 24, 25 Annual

(October)

Curriculum Chair,

Curriculum

Committee

Student Learning PCOA Exam

Metrics TBD

College, Program

Mission & SP

10, 24, 25 Annual

(June)

14


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Curriculum Chair,

Curriculum

Committee

Student Learning Student GPA

Metric: >/= 15% of

class with GPA ≤ 2.75

College, Program

Mission & SP

10, 24, 25 Annual

(July)

Curriculum Chair,

Curriculum

Committee

Student Learning Faculty/Preceptor

Assessment of

competencies in

Experiential training

(IPPE and APPE)

Metric: <50%

outstanding

Metric: < 97%%

passing

College, Program

Mission & SP

20, 22 Annual

(July)

Curriculum Chair,

Curriculum

Committee

Teaching

Effectiveness

SET scores

Mean summative

Metric Score <8

E*Value score

Metric: <4

College, Program

Mission & SP

10, 24, 25 Annual

(October)

15


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Curriculum Chair,

Curriculum

Committee

Teaching

Effectiveness

Curricular Mapping

Metric: Course

mapping to ABOs –

100%

Metric: ABOs

addressed in

curriculum – 100%

Metric: absence of

active learning in a

course

College, Program

Mission & SP

1-4, 10-

13, 24, 25

Annual

(October)

Curriculum Chair,

Curriculum

Committee

Teaching

Effectiveness

(Progression Report

from CAPP)

Grad. Rate-on time -

85%




90%



Grad Rate Overall -

95%

College, Program

Mission & SP

10-13, 17 Annual

(July)

16


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Development Development

Director

Endowments Annual Report of

Pharmacy

Metric: Number,

Donor, Amount ($)

College, Program

Mission & SP

Critical issue 5

23 Annual

(October)

Development Development

Director

Public and private

support

Annual Report of

Pharmacy

Metric: Number,

Donor, Amount ($)

College, Program

Mission & SP

23 Annual

(October)

Facilities and

Resources

Dean/Associat

e Dean

Strengthen/Strea

mline

Infrastructure/syst

ems and

Processes

Benchmarks achieved

as planned in time.

College, Program

Mission & SP

Critical issue 4

18, 23 Once

Facilities and

Resources

Dean/Associat

e Dean

Building access AACP Surveys** College, Program

Mission & SP

21, 25 Annual

(September)

Facilities and

Resources

Dean/Associat

e Dean

Classroom

technology


Mission & SP

21, 25 Annual

(September)

Facilities and

Resources

Dean/Associat

e Dean

Classrooms

Large & Small

lecture/discussion


Mission & SP

21, 25 Annual

(September)

17


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Facilities and

Resources

Dean/Associat

e Dean

Common (non-

classroom areas


Mission & SP

21, 25 Annual

(September)

Facilities and

Resources

Dean/Associat

e Dean

Computer

resources


Mission & SP

21, 25 Annual

(September)

Facilities and

Resources

Dean/Associat

e Dean

Faculty space

Office, Lab


Mission & SP

21, 25 Annual

(September)

Facilities and

Resources

Dean/Associat

e Dean

Food availability

and services


Mission & SP

21, 25 Annual

(September)

Facilities and

Resources

Dean/Associat

e Dean

Learning resource

center


Mission & SP

21, 25 Annual

(September)

Facilities and

Resources

Dean/Associat

e Dean

Library services AACP Surveys** College, Program

Mission & SP

21, 25 Annual

(September)

Facilities and

Resources

Dean/Associat

e Dean

Parking AACP Surveys** College, Program

Mission & SP

21, 25 Annual

(September)

Facilities and

Resources

Dean/Associat

e Dean

Patient care

laboratory


Mission & SP

21, 25 Annual

(September)

Facilities and

Resources

Dean/Associat

e Dean

Security AACP Surveys** College, Program

Mission & SP

21, 25 Annual

(September)

18


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Facilities and

Resources

Dean/Associat

e Dean

Staff Support AACP Surveys** College, Program

Mission & SP

21, 25 Annual

(September)

Faculty Chair, PSC

Chair, PPR

Faculty

Development Plan

TBD College, Depts,

Program Mission &

SP Critical Issues 1

& 4

14 Annual

(July)

Faculty Chair, PSC

Chair, PPR

Promotion Tenure

Metric: < 100%

attainment

Rank

Metric: Report on

Progression; < 90%

increase rank Assist to

Assoc - six years,

Assoc to Prof – 10yrs

College, Depts,

Program Mission &

SP

18, 19 Annual

(July)

Faculty Chair, PSC

Chair, PPR

Recruitment Open Positions (Lines)

Metric: position (line)

open ≥ 2 years

College, Depts,

Program Mission &

SP

18 Annual

(July)

19


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Faculty Chair, PSC

Chair, PPR

Retention Departures (non-

retiring)

Metric: zero

departures within 3

years of hire

Metric: > 2 departures

in a department per

year

Metric: ≥ 1

departure/year for 3

year period

College, Depts,

Program Mission &

SP

18 Annual

(July)

Faculty Chair, PSC

Chair, PPR

Understanding of

curriculum,

teaching and

assessment

methods,

pharmacy

profession, and

advising

responsibilities

AACP Graduating

Student and Faculty

surveys**

College, Depts,

Program Mission &

SP

18, 19 Annual

(September)

20


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Faculty Chair, PSC

Chair, PPR

Voluntary Faculty Report

Listing with

approval/re-approval

dates

Preceptor Orientation

Metric: 100%

compliance with

requirement

College, Depts,

Program Mission &

SP

18, 20 Annual

(April)

Leadership

Performance

Chair, PSC

Chair, PPR

Dean Five-Year Review

AACP student and

faculty surveys**

College, Depts,

Program Mission &


5 to 9 Every 5 years

(November)

Leadership

Performance

Dean Department

Chairs

Five-Year Review

AACP student and

faculty surveys**

College, Depts,

Program Mission &

SP

5 to 9 Every 5 years

(November)

Leadership

Performance

Department

Chairs

Faculty

Development Plan

Report on progress

Metric: Plan approval

2009

College, Depts,

Program Mission &


7, 18, 19 Annual

(July)

Leadership

Performance

Department

Chairs

Faculty Retention Report

Metric 100% retention

College, Program

Mission & SP

7, 18, 19 Annual

(July)

Leadership

Performance

Department

Chairs

Salary analysis Report

Metric: Strategic Plan

College, Program

Mission & SP

6, 7 Annual

(March)

21


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Leadership

Performance

Department

Chairs

Dean/PEC

Strategic Plan Report on progress College, Program

Mission & SP

6, 7, 25 Annual

(July)

Scholarship and

Research

Associate

Dean,

Research

Collaboration Report - PI/Co-I,

collaborators,

description,

Metric: Quantity of

collaborations with

breakout of internal,

external, funded or

not funded

College, Depts,

Program Mission &

SP Critical Issue 2

7, 18, 19,

25

Annual

(July)

22


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Scholarship and

Research

Associate

Dean,

Research

Grants/contracts Report - Role, Title,

Source, Funding for

the year, Co-I

Number of grants,

funding amount, total

and per FTE (federal

and non-federal)

Number of contracts,

funding amount, total

and per FTE (federal

and non-federal)

Metric: ↓ in AACP

ranking to 35 or

greater

Metric: ↓ in AACP

ranking by 5 places in

a year

College, Depts,

Program Mission &

SP Critical Issue 2

7, 18, 19,

25

Annual

(July)

Scholarship and

Research

Associate

Dean,

Research

Patents Report –

name/description of

patents, royalties

Metric: Quantity and

total

College, Depts,

Program Mission &

SP Critical Issue 2

7, 18, 19,

25

Annual

(July)

23


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Scholarship and

Research

Associate

Dean,

Research

Presentations Report – full citation,

meeting name and

location,

Metric: 1

national/internatnl.

presentation/FTE

College, Depts,

Program Mission &

SP Critical Issue 1

7, 18, 25 Annual

(July)

Scholarship and

Research

Associate

Dean,

Research

Publications Report – full citation;

indexed or not

indexed (Pub Med);

refereed status

Metric: 1 indexed

publication/FTE

College, Depts,

Program Mission &

SP Critical Issue 2

7, 18, 25 Annual

(July)

Scholarship and

Research

Associate

Dean,

Research

Support AACP Faculty

Survey**

College, Depts,

Program Mission &

SP Critical Issue 2

7, 18, 25 Annual

(September)

Service/Outreach PEC Campus Report - Listing

(audience, #’s

involved, amt time)

College, Depts,

Program Mission &

SP Critical Issue 5

7, 19, 25 Annual

(October)

Service/Outreach PEC Community Report - Listing

(audience, #’s

involved, amt time)

College, Depts,

Program Mission &

SP

7, 19, 25 Annual

(October)

24


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time

Service/Outreach Chairs Local/State/Regio

nal

Report

Metric: Faculty

attendance (100%)

College, Depts,

Program Mission &

SP

7, 19, 25 Annual

(October)

Service/Outreach Chairs National/Internati

onal

Report

Metric: Faculty

attendance (100%)

College, Depts,

Program Mission &

SP

7, 19, 25 Annual

(October)

Student-Life Associate

Dean

Student Advising AACP Surveys** College, Depts,

Program Mission &

SP

14, 25 Annual

(September)


Dean

Student

Complaints

AACP Surveys** College, Depts,

Program Mission &

SP

15, 25 Annual

(September)


Dean

Student Financial

Support


Program Mission &

SP

14, 25 Annual

(September)


Dean

Student Health AACP Surveys** College, Depts,

Program Mission &

SP

14, 25 Annual

(September)


Dean

Student

Registration


Program Mission &

SP

14, 25 Annual

(September)

25


Domain Responsible

Person


Tool/Metric

EACPHS and/or

Strategic Plan (SP)

ACPE

2016

Standard

PhAC Assessment

Frequency and

Time


Dean

Student-faculty

relations


Program Mission &

SP

14, 25 Annual

(September)


Dean

Tutoring AACP Surveys** College, Depts,

Program Mission &

SP

14, 25 Annual

(September)

comprehensive pharmacy evaluation and...

Documents