SITE REVIEWER SITE REVIEWER TRAINING TRAINING WORKSHOPWORKSHOP

October 26, 2012October 26, 2012

Philosophy of the Philosophy of the COSMA Accreditation COSMA Accreditation ModelModelOutcomes based/Mission drivenOutcomes based/Mission drivenAccreditation principles based on Accreditation principles based on

best practices in SM educationbest practices in SM educationDevelopmental – annual reporting Developmental – annual reporting

focused on continuous improvementfocused on continuous improvementFlexible – accommodates various Flexible – accommodates various

institutional models and innovative institutional models and innovative approachesapproaches

Benefits of Benefits of AccreditationAccreditation Dedicated staffDedicated staff Free training, assistanceFree training, assistance Best practices - templates, rubricsBest practices - templates, rubrics External accountabilityExternal accountability Enhanced reputationEnhanced reputation External assurance of qualityExternal assurance of quality Effective mechanism for continuous Effective mechanism for continuous

improvementimprovement Mechanism for program advocacyMechanism for program advocacy

Scope of Accreditation Includes both undergrad and graduate programs Academic unit should be an identifiable entity and led by a doctorally- or professionally-qualified educator Includes off-campus locations All programs included even if through cooperative or interdisciplinary arrangements All modes of delivery should be included (online, distance learning, adult degree, accelerated) In Annual Report, programs notify COSMA if a new program is being added

Scope of Accreditation, con’t Definition of “Program” – track, minor,

concentration• Within sport management degree, include all tracks• “Tracks” outside sport management degree (e.g., physical education), include sport management track

Program must provide rationale for what is included and what is not included in accreditation process If a program “appears” to be accredited by

COSMA, it must be included in the accreditation process or the program must provide rationale for why it’s not included

Steps to AccreditationSteps to Accreditation1)1) Membership application & feeMembership application & fee

2)2) Attain Candidacy Status (CS)Attain Candidacy Status (CS)

3)3) Collect data and begin writing Self Collect data and begin writing Self StudyStudy

4)4) Establish timeline for site visitEstablish timeline for site visit

5)5) Complete Self Study (at least 90 days Complete Self Study (at least 90 days prior to site visit)prior to site visit)

6)6) Site visit (2 days)Site visit (2 days)

7)7) Decision by Board of Commissioners Decision by Board of Commissioners (November/May-June of each year)(November/May-June of each year)

Quiz #1

Experience with Other Accrediting

Bodies?

COSMA individual/institutional COSMA individual/institutional membershipmembership

Submit an electronic CVSubmit an electronic CVAttend a training workshopAttend a training workshopBe familiar with COSMA Be familiar with COSMA

principles, policies & proceduresprinciples, policies & proceduresTime commitment: 2 days, Time commitment: 2 days,

preparation and follow-up preparation and follow-up

Becoming a Site Becoming a Site ReviewerReviewer

Site Visit AssignmentsSite Visit AssignmentsSchedule visits 3-6 months in Schedule visits 3-6 months in

advanceadvanceCOSMA staff, BOC assigns two COSMA staff, BOC assigns two

person team as early as possibleperson team as early as possibleConditionsConditions

Avoid conflicts of interestAvoid conflicts of interest Balance and representationBalance and representation CostsCosts

Honoraria and Travel Honoraria and Travel ReimbursementReimbursement Institution responsible for paying all Institution responsible for paying all

costs:costs: Honoraria - $300/day for team Honoraria - $300/day for team

chair; $200/day for team memberchair; $200/day for team member TravelTravel HotelHotel MealsMeals Miscellaneous costs (e.g. travel to Miscellaneous costs (e.g. travel to

and from home airport)and from home airport)

Prior to visit: 1) Review self study at Prior to visit: 1) Review self study at least twice 2) Discuss preliminary least twice 2) Discuss preliminary impressions by phone 3) Request impressions by phone 3) Request additional materials, as needed 4) additional materials, as needed 4) Modify site visit agenda, as neededModify site visit agenda, as needed

On-site: 1) Meet night before 2) On-site: 1) Meet night before 2) Stick to agenda and remain on time Stick to agenda and remain on time 3) Validate self-study materials 4) 3) Validate self-study materials 4) Write detailed reportWrite detailed report

Post-visit: 1) Write summary reportPost-visit: 1) Write summary report

Site Team Site Team ResponsibilitiesResponsibilities

Designated by COSMA staff, BOC Designated by COSMA staff, BOC Served on at least two other site Served on at least two other site

teamsteams Or, is a past member of the COSMA Or, is a past member of the COSMA

BOCBOC Coordinates visit details with the Coordinates visit details with the

institutioninstitution Review and modify site visit agendaReview and modify site visit agenda Responsible for completing a thorough Responsible for completing a thorough

and objective site visit and objective site visit Submits the completed site team Submits the completed site team

reportreport

Team Chair Role & Team Chair Role & ResponsibilitiesResponsibilities

Campus Coordinator Campus Coordinator RoleRole Person responsible for accreditation Person responsible for accreditation

process (not necessarily the process (not necessarily the department chair)department chair)

Helps team make travel plans, Helps team make travel plans, including transport to and from their including transport to and from their hotel to your campushotel to your campus

Develops site visit scheduleDevelops site visit schedule Makes sure site visit stays on scheduleMakes sure site visit stays on schedule Organizes on campus meeting room Organizes on campus meeting room

for teamfor team

Review all self-study materials and Review all self-study materials and note questions, concernsnote questions, concerns

Communicate with the other team Communicate with the other team member about initial findings, member about initial findings, concernsconcerns

Make necessary travel arrangementsMake necessary travel arrangements Phone training with COSMA Executive Phone training with COSMA Executive

DirectorDirector Develop questions to ask on siteDevelop questions to ask on site

Site Visit Site Visit Preparation/Reviewing Preparation/Reviewing

the Self Studythe Self Study

Arrive the evening before the visitArrive the evening before the visitSite Team MeetingSite Team Meeting

Re-familiarize yourself with self-study Re-familiarize yourself with self-study materialsmaterials

Discuss the schedule for the visit – who Discuss the schedule for the visit – who leads which interviewsleads which interviews

Plan opening session and exit interview Plan opening session and exit interview with Department Chair, On-site with Department Chair, On-site Coordinator, etc.Coordinator, etc.

Discuss report writing processDiscuss report writing process Determine if any additional materials are Determine if any additional materials are

neededneeded

Pre-Visit MeetingPre-Visit Meeting

Sample Site Visit Sample Site Visit Schedule: Day 1Schedule: Day 1Schedule

8:00 am Meet with dept. head to discuss two day visit

9:00 am Meet with President and/or Chief Academic Officer

9:30 am Meet with Outcomes Assessment Coordinator to review institutional plan

10:30 am

Review Sport Management O/A plan with dept. head

Noon Lunch with faculty (no administrators present)

1:30 pmWork time for site team & dept. head to validate self- study and ask questions (3 - 4 hours)

6pm Dinner

Sample Site Visit Sample Site Visit Schedule: Day 2Schedule: Day 2Schedule

8:00 am Meet with students majoring in sport management

9:00 am Tour facilities (library, classrooms, computer labs, etc.)

10:30 am

Exit interview with dept. head (and others, if desired)

Noon Lunch meeting with Advisory Board (or other parties)

1:30 pm Site team works on draft report/time for unexpected issues

3:00 pm Site team departs from campus

Self Study Self Study OrganizationOrganizationVolume 1Volume 1 Title PageTitle Page Table of ContentsTable of Contents Background informationBackground information Documentation of Accreditation PrinciplesDocumentation of Accreditation Principles

Volume 2 - AppendicesVolume 2 - Appendices Catalog (online URL okay)Catalog (online URL okay) Abbreviated SyllabiAbbreviated Syllabi Faculty CVs (full- and part-time)Faculty CVs (full- and part-time) Outcomes Assessment Plan, Results, and ActionsOutcomes Assessment Plan, Results, and Actions Strategic PlanStrategic Plan Faculty Handbook (can be separate document)Faculty Handbook (can be separate document)

Eight Principles of Eight Principles of AccreditationAccreditation Outcomes AssessmentOutcomes Assessment Strategic PlanningStrategic Planning CurriculumCurriculum FacultyFaculty Scholarly & Professional ActivitiesScholarly & Professional Activities ResourcesResources Internal & External RelationshipsInternal & External Relationships Educational InnovationEducational Innovation

Assess Key Content Areas:Assess Key Content Areas: Program assessment Program assessment

Clear and measurable student learning outcomesClear and measurable student learning outcomes

Direct and indirect measures of student learningDirect and indirect measures of student learning

Basic Skills - undergraduate and graduateBasic Skills - undergraduate and graduate

Personal development of studentsPersonal development of students

Operational effectiveness (and measurements)Operational effectiveness (and measurements)

Integration into future budgeting and planningIntegration into future budgeting and planning

Review measurement instruments and Review measurement instruments and rubricsrubrics

Review reported resultsReview reported results Note changes and improvements – Action Note changes and improvements – Action

PlanPlan

Principle 1: Outcomes Principle 1: Outcomes AssessmentAssessment

Quiz #2Which of the following are direct measures of student learning?

1.Capstone course project

2.E-portfolio

3.Comprehensive exam

4.Internship supervisor evaluation

Direct Measures of Student Learning

Demonstrate direct evidence of student learning:

• Comprehensive exams • Standardized national exams • Pretest and posttest assessments • Required structured internship• Portfolios (electronic or traditional)• Capstone project assessment• Thesis/Dissertation• External certification program (e.g., NSSE)

Indirect Measures of Student LearningAsk students (or others) about their

learning:

• Graduate survey• Alumni survey• Employer/internship supervisor survey• Exit interview• Advisory Boards• Student focus groups• Anecdotal evidence

“Closing the Loop”Institutional Goals

Student Learning Outcomes

Benchmark Measurement Tool

Results Action Plan

Communicate effectively both orally and written.

Comprehension and application of professional written and oral communication business skills.

80% of the students meet proficiency standards in writing - measured using writing rubric

Written assignments

in BU210

and BU404

85.6% of the student in BU210 & BU404 met the standard

Continue to record scores for writing evaluation the these two courses.

Discuss the possibility of a standardized test in the core courses to meet this competency

Principle 2: Strategic Principle 2: Strategic PlanningPlanning1.1. Profile of sport management programProfile of sport management program

2.2. Description, assessment of resourcesDescription, assessment of resources

3.3. External analysis – beyond COSMA External analysis – beyond COSMA site visitsite visit

4.4. SWOT analysisSWOT analysis

5.5. Student learning objectives, Student learning objectives, strategies, actions plans, and O/A strategies, actions plans, and O/A processesprocesses

6.6. Operational objectives, strategies, Operational objectives, strategies, action plans, and O/A processesaction plans, and O/A processes

Principle 3: Principle 3: CurriculumCurriculum

3.1 Program Design3.1 Program Design

3.2 Common Professional Component3.2 Common Professional Component

3.3 General Education3.3 General Education

3.4 Breadth and Depth of Curriculum3.4 Breadth and Depth of Curriculum

3.5 Curriculum Review and Improvement3.5 Curriculum Review and Improvement

3.6 Master’s Degree Curriculum3.6 Master’s Degree Curriculum

3.7 Doctoral Curriculum3.7 Doctoral Curriculum

3.2: Common 3.2: Common Professional Professional Component (CPC)Component (CPC)

A) Social, psychological A) Social, psychological and international and international foundations of sportfoundations of sport

B) ManagementB) Management1. Sport mgmt principles1. Sport mgmt principles

2. Sport leadership2. Sport leadership

3. Operations mgmt/event 3. Operations mgmt/event & & venue mgmt venue mgmt

4. Sport governance4. Sport governance

C) EthicsC) Ethics

D) Sport marketing & D) Sport marketing & communicationscommunications

E) Finance/Accounting/E) Finance/Accounting/EconomicsEconomics

1. Sport finance1. Sport finance

2. Accounting2. Accounting

3. Economics of sport3. Economics of sport

F) Legal aspects of sportF) Legal aspects of sport

G) Integrative G) Integrative experience:experience:

1. Strategic mgmt/policy1. Strategic mgmt/policy

2. Internship2. Internship

3. Capstone experience3. Capstone experience

CPC TableCPC Table

Quiz #3

Common Professional Component

Principle 4: FacultyPrinciple 4: Faculty

4.1 Faculty Qualifications4.1 Faculty Qualifications

4.2 Faculty Load4.2 Faculty Load

4.3 Program Coverage4.3 Program Coverage

4.4 Faculty Evaluation4.4 Faculty Evaluation

4.5 Faculty Development4.5 Faculty Development

4.6 Faculty Policies4.6 Faculty Policies

4.1: Faculty 4.1: Faculty QualificationsQualificationsDoctorally qualified:Doctorally qualified:

1.1. Holds Ph.D. in SM or related fieldHolds Ph.D. in SM or related field

2.2. Holds J.D. and teaches in legal environment of SMHolds J.D. and teaches in legal environment of SM

3.3. Holds out-of-field doctorate, with sufficient combination of Holds out-of-field doctorate, with sufficient combination of graduate work, professional experience, scholarly graduate work, professional experience, scholarly achievements, and successful teaching experienceachievements, and successful teaching experience

Professionally qualified:Professionally qualified:

1.1. Be A.B.D.Be A.B.D.

2.2. Hold Master’s degree in SM field and five years teaching Hold Master’s degree in SM field and five years teaching experienceexperience

3.3. Hold Master’s degree in SM-related field with post-graduate Hold Master’s degree in SM-related field with post-graduate training in areas of teaching responsibilitytraining in areas of teaching responsibility

Minimally qualified:Minimally qualified:

1. Master’s degree in field appropriate to teaching 1. Master’s degree in field appropriate to teaching responsibilitiesresponsibilities

4.1: Faculty 4.1: Faculty Qualifications, con’tQualifications, con’t

1)1) Identify the credentials of all full- and part-Identify the credentials of all full- and part-time faculty memberstime faculty members

2)2) Review current vitae for all SM faculty (in Review current vitae for all SM faculty (in Appendix)Appendix)

3)3) Review and validate all tables related to Review and validate all tables related to Faculty Coverage and Load Faculty Coverage and Load

Quiz#4

What are the minimum number of faculty needed for a

program?

Principle 5: Scholarly and Professional Activities

Scholarship of:

Teaching

Discovery

Integration

Application

Professional activities include: consulting, seminars, workshops, professional organizations

Principle 6: ResourcesPrinciple 6: Resources

6.1 Financial Resources6.1 Financial Resources

6.2 Facilities6.2 Facilities

6.3 Learning Resources6.3 Learning Resources

6.4 Educational Technology and Support6.4 Educational Technology and Support

6.5 Off-Campus Locations6.5 Off-Campus Locations

Principle 7: Internal and External Relationships

7.1 Internal Relationships7.1 Internal Relationships7.2 Admissions Processes7.2 Admissions Processes7.3 External Oversight7.3 External Oversight7.4 Business/Industry Linkages7.4 Business/Industry Linkages7.5 External Cooperative Relationships7.5 External Cooperative Relationships7.6 International Cooperation7.6 International Cooperation7.7 Diversity in Sport7.7 Diversity in Sport7.8 External Accountability7.8 External Accountability

Quiz #5

Are internships required by COSMA? a) Yes

b) No

c) Only for big institutions

d) Only if you have enough faculty

Principle 8: Educational Innovation

Evaluate the institution's support Evaluate the institution's support for innovationfor innovation

Evaluate the process in the Evaluate the process in the program for encouraging program for encouraging educational innovationeducational innovation

Review recent examples, Review recent examples, including improvementsincluding improvements

Course syllabiCourse syllabi Institutional catalogInstitutional catalog Copy of last regional accreditation self-Copy of last regional accreditation self-

study report and findingsstudy report and findings Faculty member vitaeFaculty member vitae Faculty handbookFaculty handbook O/A PlanO/A Plan Summary of realized outcomesSummary of realized outcomes

On-site MaterialsOn-site Materials

Who? Up to the department to determine – Who? Up to the department to determine – usually the campus coordinator, chair, and usually the campus coordinator, chair, and facultyfaculty

Review program strengthsReview program strengths Review areas that partially meet the principlesReview areas that partially meet the principles Review areas that do not meet the principlesReview areas that do not meet the principles Answer questions, but do not comment on Answer questions, but do not comment on

accreditation statusaccreditation status Make suggestions for how the program can Make suggestions for how the program can

remedy deficient areasremedy deficient areas Encourage the campus coordinator to talk to Encourage the campus coordinator to talk to

COSMACOSMA

Exit InterviewExit Interview

History of institution, program, degrees, special History of institution, program, degrees, special considerations, thank yous.considerations, thank yous.

Use checklist to help you write and the report Use checklist to help you write and the report templatetemplate

Summary statement: what is your overall Summary statement: what is your overall impression of the program in this area/principle?impression of the program in this area/principle?

Strengths: What does the program do well?Strengths: What does the program do well? Areas of partial compliance: In what ways does Areas of partial compliance: In what ways does

the program not meet the principle?the program not meet the principle? Link principles together, as they are relatedLink principles together, as they are related

Site Visit Report: Site Visit Report: Putting Your Findings in Putting Your Findings in

WritingWriting

 

Do’s and Don’t’sDo’s and Don’t’sDo Don’t

Validate the self study Express opinions

Provide examples to illustrate your point

“Champion” an issue

Call Heather when in doubt

“Guess” at answers

Use tact and diplomacy in exit interview

Indicate whether the institution will be accredited or not

Team chair submits final report within TWO Team chair submits final report within TWO WEEKSWEEKS

Submit expenses not directly covered by Submit expenses not directly covered by program to COSMAprogram to COSMA

Keep all notes and materials until BOC meets Keep all notes and materials until BOC meets and makes an accreditation decision – may be and makes an accreditation decision – may be questionsquestions

Maintain confidentiality: Do not share your Maintain confidentiality: Do not share your findings, materials, or opinions about the findings, materials, or opinions about the program or the site visit process with anyoneprogram or the site visit process with anyone

Submit evaluation of the site visit process and of Submit evaluation of the site visit process and of your team memberyour team member

Your Role After the Site Your Role After the Site VisitVisit

Evaluation of the Site Evaluation of the Site Team’s VisitTeam’s Visit Fill out and submit evaluation of your Fill out and submit evaluation of your

experienceexperience Site team members evaluate each otherSite team members evaluate each other All comments kept confidentialAll comments kept confidential Questions include:Questions include:

Professional behavior of the teamProfessional behavior of the team Anything overlooked by the teamAnything overlooked by the team Strengths and/or limitations of any team Strengths and/or limitations of any team

membermember

What COSMA Does What COSMA Does After the Site VisitAfter the Site Visit

Institution receives letter summarizing Institution receives letter summarizing visitvisit May include request for additional May include request for additional

informationinformation All materials sent to one member of All materials sent to one member of

Board of Commissioners – self-study, site Board of Commissioners – self-study, site visit team report, any additional visit team report, any additional informationinformation

Commissioner reviews materials and Commissioner reviews materials and prepares detailed report to present at prepares detailed report to present at next Board meetingnext Board meeting

Accreditation DecisionAccreditation Decision

Accredited with NotesAccredited with Notes Accredited with ObservationsAccredited with Observations Accreditation DeferredAccreditation Deferred Accreditation DeniedAccreditation Denied

ConclusionsConclusionsIn today’s training you learned about:In today’s training you learned about:

• The COSMA accreditation processThe COSMA accreditation process

• How site visit teams are chosen and how site visits How site visit teams are chosen and how site visits are coordinatedare coordinated

• The expectations, responsibilities, and roles of the The expectations, responsibilities, and roles of the two members of the site visit teamtwo members of the site visit team

• How to interpret each Principle of accreditationHow to interpret each Principle of accreditation

• How to conduct the exit interviewHow to conduct the exit interview

• What to write in your final reportWhat to write in your final report

• The final steps in the accreditation processThe final steps in the accreditation process

• The role of the Executive Director and the Board of The role of the Executive Director and the Board of CommissionersCommissioners

Upcoming Upcoming Training/EventsTraining/Events• Accreditation Process Training Accreditation Process Training

@AAHPERD National Convention – @AAHPERD National Convention – date TBDdate TBD

• COSMA @Sport Management Day COSMA @Sport Management Day (4/24)(4/24)

• Site Reviewer Training by Webinar – Site Reviewer Training by Webinar – date TBDdate TBD

• Fourth Annual Member Meeting – Fourth Annual Member Meeting – @NASSM, Austin, TX (5/29 – @NASSM, Austin, TX (5/29 – lunchtime)lunchtime)

Questions & Comments