ay 2007 comprehensive & annual program review data delivery plan data description process –...

46
AY 2007 Comprehensive & AY 2007 Comprehensive & Annual Program Review Annual Program Review Data Delivery Plan Data Delivery Plan Data Description Data Description Process – Timeline Process – Timeline Rev. 11-27-07 Rev. 11-27-07

Upload: julius-eaton

Post on 13-Jan-2016

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

AY 2007 Comprehensive & AY 2007 Comprehensive & Annual Program Review Data Annual Program Review Data

Delivery PlanDelivery Plan

Data DescriptionData DescriptionProcess – TimelineProcess – Timeline

Rev. 11-27-07Rev. 11-27-07

Page 2: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

PurposePurposeThe primary purpose of this presentation is to provide clarity to all instructional programs The primary purpose of this presentation is to provide clarity to all instructional programs on where and how the data is calculated for both the Comprehensive and our system on where and how the data is calculated for both the Comprehensive and our system required Annual Program Reviews.required Annual Program Reviews.

We have been asked to produce an annual program review for each and every one of our We have been asked to produce an annual program review for each and every one of our instructional programs and units. They are required of each system CC and will be taken instructional programs and units. They are required of each system CC and will be taken to the U of H Board of Regents for their review.to the U of H Board of Regents for their review.

The system has changed it’s scheduled due date for annual reviews to be nearly on top of The system has changed it’s scheduled due date for annual reviews to be nearly on top of our normally scheduled comprehensive reviews. We may want to reevaluate the our normally scheduled comprehensive reviews. We may want to reevaluate the scheduling next year to see if it makes more sense to spread the reviews out a little more.scheduling next year to see if it makes more sense to spread the reviews out a little more.

So who has to do a program review this year? If you are normally scheduled to do a So who has to do a program review this year? If you are normally scheduled to do a comprehensive or are “Jumping” you will do a comprehensive review this year. comprehensive or are “Jumping” you will do a comprehensive review this year. Additionally, every instructional and non-instructional program will do an Annual Program Additionally, every instructional and non-instructional program will do an Annual Program Review this year.Review this year.

Not sure if you’re scheduled for a comprehensive or not? Not sure if you’re scheduled for a comprehensive or not?

Click here for the Click here for the Comprehensive Program-Unit ScheduleComprehensive Program-Unit Schedule..

Page 3: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

What’s a Jumper?What’s a Jumper?

Jumper is a technical term that is used to describe an instructional program Jumper is a technical term that is used to describe an instructional program or non-instructional program (unit) that has decided to jump out of their or non-instructional program (unit) that has decided to jump out of their normally scheduled slot for their comprehensive program reviews and into normally scheduled slot for their comprehensive program reviews and into this years cycle.this years cycle.

Why would anyone want to do that? Jumping into this years comprehensive Why would anyone want to do that? Jumping into this years comprehensive cycle means that you will have an opportunity to be considered for any cycle means that you will have an opportunity to be considered for any budgetary decisions that will be made in this years biennium budget budgetary decisions that will be made in this years biennium budget process.process.

Then I don’t have to do another comprehensive for another 4 years? Not so Then I don’t have to do another comprehensive for another 4 years? Not so fast…Jumpers will still have to do their comprehensive review on their next fast…Jumpers will still have to do their comprehensive review on their next scheduled review. Jumping does not affect the existing schedule—you are scheduled review. Jumping does not affect the existing schedule—you are voluntarily doing an extra review to be considered in this budget cycle.voluntarily doing an extra review to be considered in this budget cycle.

Page 4: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

I belong to an Instructional Program… which I belong to an Instructional Program… which template do I use?template do I use?

A datasheet will be provided to all instructional programs for use in both the A datasheet will be provided to all instructional programs for use in both the comprehensive and annual reviews.comprehensive and annual reviews.There are 3 templates available to Instructional Programs this year. Simply click on There are 3 templates available to Instructional Programs this year. Simply click on the template below that applies to your current situation, paste in the completed the template below that applies to your current situation, paste in the completed datasheet where needed, and then fill in the template:datasheet where needed, and then fill in the template:

Instructional Comprehensive Program Review TemplateInstructional Comprehensive Program Review Template(Use this template ONLY if you are scheduled for a comprehensive program review (Use this template ONLY if you are scheduled for a comprehensive program review

this year or are jumping)this year or are jumping)

AY 2007 Annual Program Review TemplateAY 2007 Annual Program Review Template((ALLALL Instructional programs will need to complete this) Instructional programs will need to complete this)

AY 2007 Annual Program Review CoversheetAY 2007 Annual Program Review Coversheet((ALLALL Instructional programs will need to complete this) Instructional programs will need to complete this)

Page 5: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

I belong to a non-instructional unit…What template I belong to a non-instructional unit…What template do I use?do I use?

If you are on the schedule for a comprehensive unit review or are jumping you will be using the If you are on the schedule for a comprehensive unit review or are jumping you will be using the

comprehensive unit review template below.comprehensive unit review template below.

Comprehensive Unit Review TemplateComprehensive Unit Review Template

For annuals, if you are writing your unit review in support of Administrative Services you will For annuals, if you are writing your unit review in support of Administrative Services you will use:use:

Administrative Services TemplateAdministrative Services Template

For annuals, if you are writing your unit review in support of Student Services you will use:For annuals, if you are writing your unit review in support of Student Services you will use:

Student Services TemplateStudent Services Template

For annuals, if your unit is other than Student Services or Administrative Services you will use:For annuals, if your unit is other than Student Services or Administrative Services you will use:

Generic Annual Unit Review TemplateGeneric Annual Unit Review Template

For annuals, For annuals, ALLALL units need to complete the following coversheet, which is required by our units need to complete the following coversheet, which is required by our System Office.System Office.

Annual Unit Coversheet Annual Unit Coversheet (not available from system yet)(not available from system yet)

Page 6: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

Instructional Program Paid CoursesInstructional Program Paid Courses

Since we currently have no way of determining or flagging your program courses in our Since we currently have no way of determining or flagging your program courses in our student information system, we have asked for your help in identifying them.student information system, we have asked for your help in identifying them.

Today’s process is to look at all courses taught over the last full academic year, add all of Today’s process is to look at all courses taught over the last full academic year, add all of our new courses to that list, and then work with the Assistant VCAA to help place all our new courses to that list, and then work with the Assistant VCAA to help place all courses in the correct program.courses in the correct program.

Before using the PPC’s in our program review we will do a validation with the Division Before using the PPC’s in our program review we will do a validation with the Division Chairs to ensure that the courses listed under your program are in fact your program paid Chairs to ensure that the courses listed under your program are in fact your program paid courses. This gives us an opportunity to close any gaps prior to running the data, which courses. This gives us an opportunity to close any gaps prior to running the data, which should help to eliminate any reruns.should help to eliminate any reruns.

In short, the PPC are the courses that your program is responsible for. They are the In short, the PPC are the courses that your program is responsible for. They are the courses taught by the programs faculty and lecturers who are paid by the program.courses taught by the programs faculty and lecturers who are paid by the program.

This may include courses taught by the programs faculty and lecturers that are paid by the This may include courses taught by the programs faculty and lecturers that are paid by the programs grant money as well—they are still being paid by the program.programs grant money as well—they are still being paid by the program.

Not sure what’s listed for your program?Not sure what’s listed for your program? Check the Check the Master PPC ListingMaster PPC Listing

Page 7: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

Program Paid Courses Program Paid Courses are…are…

All Liberal Arts A.A. degree courses taken directly from All Liberal Arts A.A. degree courses taken directly from the General Catalog EXCEPT for elective courses.the General Catalog EXCEPT for elective courses.

PPC as defined by DC/Program Initiators, and Assistant PPC as defined by DC/Program Initiators, and Assistant Dean’s of Instruction.Dean’s of Instruction.

Any course described as an Experimental course with a Any course described as an Experimental course with a course number such as 197, 198, 297, or 298.course number such as 197, 198, 297, or 298.

Page 8: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

Courses Courses Not Counted Not Counted asas Program Paid Program Paid

Any course described as Coop Voc Ed such as 93V or Any course described as Coop Voc Ed such as 93V or 193V.193V.

Any course described as Independent/Directed Studies Any course described as Independent/Directed Studies such as 99V, 199V, or 299V.such as 99V, 199V, or 299V.

Any Liberal Arts A.A. degree elective courses.Any Liberal Arts A.A. degree elective courses.

Any Liberal Arts A.A. degree non-elective courses under Any Liberal Arts A.A. degree non-elective courses under 100 level.100 level.

Page 9: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

AY 2007 Comprehensive-Annual Instructional AY 2007 Comprehensive-Annual Instructional Program Review Data ElementsProgram Review Data Elements

At this point in time we do have a working routine to generate your data. It will At this point in time we do have a working routine to generate your data. It will take a couple more days of data checking before we can deliver your completed take a couple more days of data checking before we can deliver your completed data tables. We are hoping to deliver the data tables by Friday, November 2data tables. We are hoping to deliver the data tables by Friday, November 2ndnd……earlier if humanly possible. earlier if humanly possible.

The data tables you will be receiving will cover the last 3 full academic years The data tables you will be receiving will cover the last 3 full academic years AY04-AY07 and lists 32 different data elements from a variety of sources.AY04-AY07 and lists 32 different data elements from a variety of sources.

Student information data this year comes exclusively from the Operational Data Student information data this year comes exclusively from the Operational Data Store (ODS). Organizationally this means that all community colleges are Store (ODS). Organizationally this means that all community colleges are getting the data from the same place and at the same snapshot in time (this is a getting the data from the same place and at the same snapshot in time (this is a good thing).good thing).

The following slides will explain in detail what data has been provided to you for The following slides will explain in detail what data has been provided to you for your comprehensive-annual instructional program review write ups and how it your comprehensive-annual instructional program review write ups and how it has been calculated.has been calculated.

Page 10: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

What’s different this year?What’s different this year?

This year the system has provided the routines that go out and get your data. This is a This year the system has provided the routines that go out and get your data. This is a good thing because we can now begin to document exactly how the data is being queried, good thing because we can now begin to document exactly how the data is being queried, what student information system is being queried, the table and field names used in the what student information system is being queried, the table and field names used in the query, and how the data is calculated. query, and how the data is calculated.

The system is not providing information on program budgets, expenses, program health The system is not providing information on program budgets, expenses, program health calls, or PHI data so we will have to collect our own data for the program review.calls, or PHI data so we will have to collect our own data for the program review.

Since we have no UHCC agreed upon methodology for determining what a program Since we have no UHCC agreed upon methodology for determining what a program course is, the system developed the routines to only look for program courses with the course is, the system developed the routines to only look for program courses with the same subject code. This means that a program like ABRP will run fine because all of the same subject code. This means that a program like ABRP will run fine because all of the program paid courses (PPC) (our local definition for a program course) have the ABRP program paid courses (PPC) (our local definition for a program course) have the ABRP subject code. A program that does not have all of the same subject codes listed in it’s subject code. A program that does not have all of the same subject codes listed in it’s PPC will not return all of the course data for the program. For example, using the system PPC will not return all of the course data for the program. For example, using the system routines, a program like Accounting will not return any of the Business courses, Ent 197, or routines, a program like Accounting will not return any of the Business courses, Ent 197, or IS 55.IS 55.

This means we need to write the routines that enable us to get This means we need to write the routines that enable us to get allall of our course data, of our course data, program budgets, expenses, program health calls, and PHI data that the system routine program budgets, expenses, program health calls, and PHI data that the system routine leaves out.leaves out.

Page 11: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

A word about terminologyA word about terminology

Since we are using the ODS this year to get the majority of the data a Since we are using the ODS this year to get the majority of the data a short primer on terminology would be prudent. The following data short primer on terminology would be prudent. The following data elements are used in the queries we build to get much of your data. elements are used in the queries we build to get much of your data.

Many of the routines filter on the students in a field called “IRO Many of the routines filter on the students in a field called “IRO Institution”. This is the UH institution at which a student is registered for Institution”. This is the UH institution at which a student is registered for credit classes.credit classes.

Freeze Event is locked down on either Census or End of Semester Freeze Event is locked down on either Census or End of Semester (EOS). The freeze event allows all institutions to look at the data at the (EOS). The freeze event allows all institutions to look at the data at the same snapshot in time. This is a critical element for an organization that same snapshot in time. This is a critical element for an organization that desires to consistently report the same values based on when the data desires to consistently report the same values based on when the data was frozen. Census is the 5was frozen. Census is the 5thth Friday after the start of instruction, and Friday after the start of instruction, and EOS is 10 weeks after the end of instruction.EOS is 10 weeks after the end of instruction.

Page 12: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#1#1 Annual new and replacement Annual new and replacement positions in the state.positions in the state.

This data element represents the combined new and replacement This data element represents the combined new and replacement jobs for the jobs for the StateState of Hawaii in your trade, projected for the period of Hawaii in your trade, projected for the period 2005-2011.2005-2011.

The data comes from the system office in a report created by the The data comes from the system office in a report created by the EMSI application they have license to.EMSI application they have license to.

EMSI stands for Economic Modeling Specialist Inc.EMSI stands for Economic Modeling Specialist Inc.

From their website, “…EMSI specializes in reports that analyze and From their website, “…EMSI specializes in reports that analyze and quantify the total economic benefits of community and technical quantify the total economic benefits of community and technical colleges in their region, and also creates data-driven strategic colleges in their region, and also creates data-driven strategic planning tools that help colleges maximize their impact through planning tools that help colleges maximize their impact through labor market responsiveness…” labor market responsiveness…”

Page 13: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#2#2 Annual new and replacement Annual new and replacement positions in the County.positions in the County.

This data element represents the combined new and replacement This data element represents the combined new and replacement jobs for the jobs for the CountyCounty of Hawaii in your trade, projected for the period of Hawaii in your trade, projected for the period 2005-2011.2005-2011.

The data comes from the system office in a report created by the The data comes from the system office in a report created by the EMSI application they have license to.EMSI application they have license to.

EMSI stands for Economic Modeling Specialist Inc.EMSI stands for Economic Modeling Specialist Inc.

From their website, “…EMSI specializes in reports that analyze and From their website, “…EMSI specializes in reports that analyze and quantify the total economic benefits of community and technical quantify the total economic benefits of community and technical colleges in their region, and also creates data-driven strategic colleges in their region, and also creates data-driven strategic planning tools that help colleges maximize their impact through planning tools that help colleges maximize their impact through labor market responsiveness…” labor market responsiveness…”

Page 14: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#3#3 Number of MajorsNumber of Majors

This is total number of students registered at Hawaii This is total number of students registered at Hawaii Community College for credit classes within the declared Community College for credit classes within the declared major.major.

This is as of Fall semester at census.This is as of Fall semester at census.

Page 15: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#4#4 Student Semester Hours for program Student Semester Hours for program majors in all program classesmajors in all program classes

This is the sum of semester hours for registered students This is the sum of semester hours for registered students in credit classes in credit classes withinwithin the declared major. the declared major.

This is as of Fall semester at census.This is as of Fall semester at census.

Semester hours are defined here as the “Attempted” Semester hours are defined here as the “Attempted” semester hours—not earned credits.semester hours—not earned credits.

Note that “program classes” here refers to your program Note that “program classes” here refers to your program paid courses (PPC’s).paid courses (PPC’s).

SSH excludes Directed Studies courses (99, 099, SSH excludes Directed Studies courses (99, 099, 199,299) but includes Cooperative Ed courses (93, 093, 199,299) but includes Cooperative Ed courses (93, 093, 193, 293)193, 293)

Page 16: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#5#5 Student Semester Hours for non-Student Semester Hours for non-program majors in all program classesprogram majors in all program classes

This is the sum of semester hours for registered students This is the sum of semester hours for registered students in credit classes in credit classes notnot within the declared major. within the declared major.

This is as of Fall semester at census.This is as of Fall semester at census.

Semester hours are defined here as the “Attempted” Semester hours are defined here as the “Attempted” semester hours—not earned credits.semester hours—not earned credits.

Note that “program classes” here refers to your program Note that “program classes” here refers to your program paid courses (PPC’s).paid courses (PPC’s).

SSH excludes Directed Studies courses (99, 099, SSH excludes Directed Studies courses (99, 099, 199,299) but includes Cooperative Ed courses (93, 093, 199,299) but includes Cooperative Ed courses (93, 093, 193, 293)193, 293)

Page 17: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#6#6 Student Semester Hours for all Student Semester Hours for all students in program classesstudents in program classes

This is the sum of semester hours for registered students This is the sum of semester hours for registered students in credit classes without regard for the declared major.in credit classes without regard for the declared major.

This is as of Fall semester at census.This is as of Fall semester at census.

Semester hours are defined here as the “Attempted” Semester hours are defined here as the “Attempted” semester hours—not earned credits.semester hours—not earned credits.

Note that “program classes” here refers to your program Note that “program classes” here refers to your program paid courses (PPC’s).paid courses (PPC’s).

SSH includes Cooperative Ed courses (93, 093, 193, SSH includes Cooperative Ed courses (93, 093, 193, 293)293)

Page 18: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#7#7 StudentStudent FTE Program EnrollmentFTE Program Enrollment

This is the sum of semester hours for all registered This is the sum of semester hours for all registered students in credit classes without regard for the declared students in credit classes without regard for the declared major (from data element #6 ) / 15 credits for full time.major (from data element #6 ) / 15 credits for full time.

This is as of Fall semester at census.This is as of Fall semester at census.

Semester hours are defined here as the “Attempted” Semester hours are defined here as the “Attempted” semester hours—not earned credits.semester hours—not earned credits.

Page 19: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#8#8 Number of Classes TaughtNumber of Classes Taught

This is the number of program paid courses (actual This is the number of program paid courses (actual sections) taught in the program.sections) taught in the program.

This is as of Fall semester at census.This is as of Fall semester at census.

Semester hours are defined here as the “Attempted” Semester hours are defined here as the “Attempted” semester hours—not earned credits.semester hours—not earned credits.

The number of classes taught excludes Directed Studies The number of classes taught excludes Directed Studies courses (99, 099, 199,299) but includes Cooperative Ed courses (99, 099, 199,299) but includes Cooperative Ed courses (93, 093, 193, 293)courses (93, 093, 193, 293)

Page 20: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#9#9 Determination of program’s health based on Determination of program’s health based on demand (Healthy, Cautionary, or Unhealthy)demand (Healthy, Cautionary, or Unhealthy)

This determination has yet to be decided…who makes This determination has yet to be decided…who makes call, when call gets made, etc.call, when call gets made, etc.

Page 21: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#10#10 Average Class SizeAverage Class Size

Average class size is the sum of registrations in each of Average class size is the sum of registrations in each of the PPC classes divided by the total number of classes.the PPC classes divided by the total number of classes.

This is as of Fall semester at census.This is as of Fall semester at census.

This excludes Directed Studies courses (99, 099, This excludes Directed Studies courses (99, 099, 199,299) but includes Cooperative Ed courses (93, 093, 199,299) but includes Cooperative Ed courses (93, 093, 193, 293)193, 293)

Page 22: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#11#11 Class Fill RateClass Fill Rate

Class fill rate is the sum of registrations in each of the Class fill rate is the sum of registrations in each of the PPC classes divided by the sum of maximum PPC classes divided by the sum of maximum enrollments.enrollments.

This is as of Fall semester at census.This is as of Fall semester at census.

Page 23: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#12#12 FTE of BOR Appointed Program FacultyFTE of BOR Appointed Program Faculty

FTE of BOR Appointed Program Faculty is the sum of FTE of BOR Appointed Program Faculty is the sum of appointments to your program (1.0, 0.5, etc)appointments to your program (1.0, 0.5, etc)

Remember that these are positions that were appointed Remember that these are positions that were appointed to your program—whether or not these people are to your program—whether or not these people are actually teaching classes or not.actually teaching classes or not.

If a professor is on sabbatical for instance they are still If a professor is on sabbatical for instance they are still included in this number.included in this number.

This is for the academic year.This is for the academic year.

Page 24: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#13#13 Student Faculty RatioStudent Faculty Ratio

Student faculty ratio is the number of student majors Student faculty ratio is the number of student majors (from data element #3) divided by the number of BOR (from data element #3) divided by the number of BOR Appointed Program Faculty (from data element #12)Appointed Program Faculty (from data element #12)

Student Majors are taken as of Fall semester at census.Student Majors are taken as of Fall semester at census.

Note: this is not all students taking your classes…just the Note: this is not all students taking your classes…just the majors.majors.

Page 25: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#14#14 Number of Majors per FTE FacultyNumber of Majors per FTE Faculty

Total number of fall majors (from data element #3) Total number of fall majors (from data element #3) divided by FTE faculty.divided by FTE faculty.

FTE faculty is a workload measure not to be confused FTE faculty is a workload measure not to be confused with BOR Appointments. It is calculated by taking all of with BOR Appointments. It is calculated by taking all of the semester hours taught in PPC classes and dividing the semester hours taught in PPC classes and dividing them by 15 credits for full load.them by 15 credits for full load.

Student Majors are taken as of Fall semester at census.Student Majors are taken as of Fall semester at census.

Page 26: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#15#15 Program Budget AllocationProgram Budget Allocation

Program budget allocation should include: Personnel, Program budget allocation should include: Personnel, supplies and services, and equipment.supplies and services, and equipment.

We will calculate personnel costs by multiplying the We will calculate personnel costs by multiplying the Faculty FTE, which includes lecturers, by the AY 2007 Faculty FTE, which includes lecturers, by the AY 2007 UHPA faculty rank 4 rate per credit hour value of $1551, UHPA faculty rank 4 rate per credit hour value of $1551, then by 30 credits.then by 30 credits.

Personnel costs plus b budget costs equal the program Personnel costs plus b budget costs equal the program budget allocation.budget allocation.

Perhaps this element should be labeled, “Program Perhaps this element should be labeled, “Program Costs” as these are expenses to the program…Costs” as these are expenses to the program…

Page 27: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#16#16 Cost per Student Semester HourCost per Student Semester Hour

This is the cost to run your program based on student This is the cost to run your program based on student semester hours.semester hours.

Costs come from Program Budget Allocation (data Costs come from Program Budget Allocation (data element #15) divided by student semester hours for all element #15) divided by student semester hours for all students in program classes (from data element #6)students in program classes (from data element #6)

It should be noted that we are dividing the number of It should be noted that we are dividing the number of student semester hours from the Fall semester by an student semester hours from the Fall semester by an annual figure.annual figure.

Page 28: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#17#17 Number of classes that enroll less than 10 Number of classes that enroll less than 10 studentsstudents

This is the number of PPC classes where the student This is the number of PPC classes where the student registrations are less than 10.registrations are less than 10.

These are registered students in fall semester as of These are registered students in fall semester as of census. census.

Page 29: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#18#18 Determination of program’s health based on Determination of program’s health based on efficiency ( Healthy, Cautionary, or Unhealthy)efficiency ( Healthy, Cautionary, or Unhealthy)

To be determined.To be determined.

Page 30: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#19#19 Persistence of Majors Fall to SpringPersistence of Majors Fall to Spring

Student records for the declared major in the Fall Student records for the declared major in the Fall semester at census are compared to the student records semester at census are compared to the student records in the declared major in the Spring semester.in the declared major in the Spring semester.

Spring records that were also in the fall are persisting.Spring records that were also in the fall are persisting.

Persistence fall to spring = Spring persistence / Fall Persistence fall to spring = Spring persistence / Fall majors.majors.

Example: Example: 31 majors start in Fall31 majors start in Fall

21 majors persist into Spring21 majors persist into Spring21/31 = .6774 or 67.74%21/31 = .6774 or 67.74%

Page 31: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#20#20 Number of Degrees Earned (annual)Number of Degrees Earned (annual)

The number of degrees earned are counted as of the The number of degrees earned are counted as of the fiscal year. For example, AY 2007 is roughly equivalent fiscal year. For example, AY 2007 is roughly equivalent to the 2007 fiscal year.to the 2007 fiscal year.

We are counting the student major outcomes such as We are counting the student major outcomes such as AAS, AA, AS, etc.AAS, AA, AS, etc.

Page 32: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#21#21 Number of Certificates Earned (annual)Number of Certificates Earned (annual)

The number of certificates earned are counted as of the The number of certificates earned are counted as of the fiscal year. For example, AY 2007 is roughly equivalent fiscal year. For example, AY 2007 is roughly equivalent to the 2007 fiscal year.to the 2007 fiscal year.

We are counting the student major outcomes such as We are counting the student major outcomes such as CC, CA, etc.CC, CA, etc.

Page 33: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#22#22 Number of Students Transferred to a 4-Year Number of Students Transferred to a 4-Year InstitutionInstitution

This is the number of students that were enrolled in the This is the number of students that were enrolled in the 0607 academic year at UH Manoa, UH West Oahu, or 0607 academic year at UH Manoa, UH West Oahu, or UH Hilo for the first time…UH Hilo for the first time…

And, not enrolled UHM, UHWO, or UHH at any time in And, not enrolled UHM, UHWO, or UHH at any time in the previous academic year…the previous academic year…

And, had an enrollment at HawCC at any time in that And, had an enrollment at HawCC at any time in that same previous academic year…same previous academic year…

And their cumulative earned student semester hours And their cumulative earned student semester hours were more or equal to 12.were more or equal to 12.

Page 34: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#23#23 Perkins Core Indicator: Academic Perkins Core Indicator: Academic Attainment (1P1)Attainment (1P1)

Perkins Core Indicators are used in the development of the HawCC Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports completed annually for CTE Program Health Indicator (PHI) reports completed annually for CTE programs. The data that you see in your program review is actually programs. The data that you see in your program review is actually representative of the previous academic year.representative of the previous academic year.

Academic Attainment is calculated by:Academic Attainment is calculated by:

Concentrators who have a cumulative GPA >= 2.0 in academic courses and Concentrators who have a cumulative GPA >= 2.0 in academic courses and who have stopped program participation in the year reportedwho have stopped program participation in the year reported

Concentrators , with academic courses, who have stopped program Concentrators , with academic courses, who have stopped program participation in the year reportedparticipation in the year reported

Page 35: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#24#24 Perkins Core Indicator: Technical Skill Perkins Core Indicator: Technical Skill Attainment (1P2)Attainment (1P2)

Perkins Core Indicators are used in the development of Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports the HawCC Program Health Indicator (PHI) reports completed annually for CTE programs. The data that completed annually for CTE programs. The data that you see in your program review is actually representative you see in your program review is actually representative of the previous academic year.of the previous academic year.

Technical Skill Attainment is calculated by:Technical Skill Attainment is calculated by:

Concentrators who have a cumulative GPA >= 2.0 in vocational courses Concentrators who have a cumulative GPA >= 2.0 in vocational courses and who have stopped program participation in the year reportedand who have stopped program participation in the year reported

Concentrators who have stopped program participation in the year reportedConcentrators who have stopped program participation in the year reported

Page 36: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#25#25 Perkins Core Indicator: Completion Rate Perkins Core Indicator: Completion Rate (2P1)(2P1)

Perkins Core Indicators are used in the development of Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports the HawCC Program Health Indicator (PHI) reports completed annually for CTE programs. The data that completed annually for CTE programs. The data that you see in your program review is actually representative you see in your program review is actually representative of the previous academic year.of the previous academic year.

Completion rate is calculated by:Completion rate is calculated by:

Concentrators who have received a vocational degree or certificate and who Concentrators who have received a vocational degree or certificate and who have stopped program participation in the year reportedhave stopped program participation in the year reported

Concentrators who have stopped program participation in the year reportedConcentrators who have stopped program participation in the year reported

Page 37: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#26#26 Perkins Core Indicator: Placement in Perkins Core Indicator: Placement in Employment, Education and Military (3P1)Employment, Education and Military (3P1)

Perkins Core Indicators are used in the development of the HawCC Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports completed annually for CTE Program Health Indicator (PHI) reports completed annually for CTE programs. The data that you see in your program review is actually programs. The data that you see in your program review is actually representative of the previous academic year.representative of the previous academic year.

Placement in employment, education, and military is calculated by:Placement in employment, education, and military is calculated by:

Completers in the year reported (previous Perkins year) who have stopped Completers in the year reported (previous Perkins year) who have stopped program participation and who transferred or are employed within one program participation and who transferred or are employed within one

employment quarter following program completionemployment quarter following program completion

Completers in the year reported (previous Perkins year) who have stopped Completers in the year reported (previous Perkins year) who have stopped

program participationprogram participation

Page 38: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#27#27 Perkins Core Indicator: Retention in Perkins Core Indicator: Retention in Employment (3P2)Employment (3P2)

Perkins Core Indicators are used in the development of the HawCC Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports completed annually for CTE Program Health Indicator (PHI) reports completed annually for CTE programs. The data that you see in your program review is actually programs. The data that you see in your program review is actually representative of the previous academic year.representative of the previous academic year.

Retention in employment is calculated by:Retention in employment is calculated by:

Numerator 3P1 retained in employment for a second quarter and continuing transfersNumerator 3P1 retained in employment for a second quarter and continuing transfers

Completers in the year reported (previous Perkins year) who have stopped Completers in the year reported (previous Perkins year) who have stopped program participation and who transferred or are employed within one employment program participation and who transferred or are employed within one employment

quarter following program completion (Numerator of Report 3P1)quarter following program completion (Numerator of Report 3P1)

Page 39: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#28#28 Perkins Core Indicator: Non-Traditional Perkins Core Indicator: Non-Traditional Participation (4P1)Participation (4P1)

Perkins Core Indicators are used in the development of Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports the HawCC Program Health Indicator (PHI) reports completed annually for CTE programs. The data that completed annually for CTE programs. The data that you see in your program review is actually representative you see in your program review is actually representative of the previous academic year.of the previous academic year.

Non-Traditional participation is calculated by:Non-Traditional participation is calculated by:

Participants in under-represented gender groups who participated in Participants in under-represented gender groups who participated in nontraditional programs in the year reportednontraditional programs in the year reported

Participants in nontraditional programs in the year reportedParticipants in nontraditional programs in the year reported

Page 40: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#29#29 Perkins Core Indicator: Non-Traditional Perkins Core Indicator: Non-Traditional Completion (4P2)Completion (4P2)

Perkins Core Indicators are used in the development of Perkins Core Indicators are used in the development of the HawCC Program Health Indicator (PHI) reports the HawCC Program Health Indicator (PHI) reports completed annually for CTE programs. The data that completed annually for CTE programs. The data that you see in your program review is actually representative you see in your program review is actually representative of the previous academic year.of the previous academic year.

Non-Traditional participation is calculated by:Non-Traditional participation is calculated by:

Completers in under-represented gender groups in Completers in under-represented gender groups in nontraditional programs in the year reportednontraditional programs in the year reported

Completers in nontraditional programs in the year reportedCompleters in nontraditional programs in the year reported

Page 41: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#30#30 Determination of Program’s Health Based Determination of Program’s Health Based upon Effectiveness (Healthy, Cautionary, upon Effectiveness (Healthy, Cautionary,

Unhealthy)Unhealthy)

To Be determined…To Be determined…

Page 42: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#31#31 Determination of Program’s Overall Health Determination of Program’s Overall Health (Healthy, Cautionary, Unhealthy)(Healthy, Cautionary, Unhealthy)

To Be determined…To Be determined…

Page 43: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

#32#32 Number of FTE FacultyNumber of FTE Faculty

FTE Faculty is determined by taking all of the credits that FTE Faculty is determined by taking all of the credits that instructors earn by teaching a course and summing them instructors earn by teaching a course and summing them up, and then dividing by 15 credits for the full time up, and then dividing by 15 credits for the full time equivalent value.equivalent value.

This is Fall semester only.This is Fall semester only.

The courses that are considered in this calculation are The courses that are considered in this calculation are your PPC courses for your program.your PPC courses for your program.

The number of FTE Faculty includes both Faculty and The number of FTE Faculty includes both Faculty and Lecturers.Lecturers.

Page 44: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

Comprehensive & Annual Program Review TimelineComprehensive & Annual Program Review Timeline

Validate program/unit listing held by system and return

Develop process, training materials, and timeline

Develop 2007 program review in the assessment website

Oct 3-26

Provide Annual Program Review Training to Campus

Delivery of 44 Program & Unit Reviews to System Office

Post 44 Program & Unit Reviews to Assessment Website

Dec 14

When Reviews are complete.

October 26th

Oct 16-26

12Oct07

All instructional program and unit reviews (Comprehensive and Annual) due to VCAA by email by EOB Friday November 30th

30Nov07

Deliver data for instructional programs

November 2nd

Page 45: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

AY2007 Comprehensive & Annual Review ProcessAY2007 Comprehensive & Annual Review Process

Step 1Step 1 Write your instructional or unit review using the Write your instructional or unit review using the appropriate template's.appropriate template's.

Step 2Step 2 Send yourSend your documents to VCAA Doug Dykstra by email documents to VCAA Doug Dykstra by email no later than end of business, Friday November 30th. no later than end of business, Friday November 30th.

Step 3Step 3 VCAA will ensure that all reviews and coversheets have VCAA will ensure that all reviews and coversheets have been received and that they are adequate.been received and that they are adequate.

Step 4Step 4 VCAA will forward all approved reviews to IR Shawn VCAA will forward all approved reviews to IR Shawn Flood for further processing.Flood for further processing.

Step 5Step 5 The Annual reviews will be appropriately packaged and The Annual reviews will be appropriately packaged and sent to the System Office for review by the UH Board of sent to the System Office for review by the UH Board of Regents. Comprehensive reviews will be forwarded Regents. Comprehensive reviews will be forwarded along along as appropriate.as appropriate.

Step 6Step 6 All reviews will finally be converted to PDF and posted All reviews will finally be converted to PDF and posted to the Assessment Web Site.to the Assessment Web Site.

Page 46: AY 2007 Comprehensive & Annual Program Review Data Delivery Plan Data Description Process – Timeline Rev. 11-27-07

Questions?Questions?

The intention of this presentation was to provide one source for all The intention of this presentation was to provide one source for all of the documentation related to the Comprehensive & Annual of the documentation related to the Comprehensive & Annual Program Review process. I have linked all of the documents you Program Review process. I have linked all of the documents you should need directly into this presentation.should need directly into this presentation.

If you need more information on this process please feel free to If you need more information on this process please feel free to contact me:contact me:

Shawn FloodShawn Flood 974-7512974-7512

Mahalo!Mahalo!