![Page 1: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/1.jpg)
Assessment 101(Academic and Administrative)
Marta Colón de Toro, SPHRAssessment Coordinator
College of Business AdministrationUPR-Mayagüez
![Page 2: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/2.jpg)
2
Today’s Learning Goals
After completing this workshop you should be able to:
1. Explain the importance and purpose of assessing outcomes, both, academic and administrative.
2. Recognize accreditation standards on assessment.3. Describe the process of assessment and the challenges it
represents.4. Develop a plan to conduct assessment.5. Identify and apply appropriate instruments to directly assess
outcomes in your area.6. Identify ways to document assessment.
![Page 3: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/3.jpg)
3
Tell me…
Why are we here today?
Why are we here, at UPR-Mayagüez?
![Page 4: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/4.jpg)
4
A Transformation Process
• Demographics• Academics• Experience• Talents• Attitudes/Values
Completing
Student
Input University Processes OutputCurriculum
Seminars and Competitions
Internship/CoopStudent Associations
Extracurricular ExperiencesEnvironment/Services
• Knowledge• Skills• Abilities• Experience• Attitudes/Values
Incoming Student
![Page 5: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/5.jpg)
5
UPR-Mayagüez
MisiónEl Recinto Universitario de Mayagüez tiene como misión dirigir sus esfuerzos para proveer a nuestra sociedad ciudadanos educados, cultos, capaces de pensar críticamente y preparados profesionalmente en los campos de la agricultura, la ingeniería, las ciencias naturales y sociales, las humanidades y la administración de empresas, para que contribuyan al desarrollo cultural, social y económico de Puerto Rico.
Este proceso está dirigido a dotar a nuestros egresados de una preparación técnica y profesionalmente sólida y a desarrollar en ellos una actitud de compromiso con Puerto Rico y con nuestro Hemisferio. Nuestros egresados deben poseer, además las destrezas y los conocimientos necesarios que les permitan participar efectivamente en la búsqueda de soluciones a los problemas que nos afectan, propulsar el enriquecimiento de las artes y la cultura, la transferencia de tecnología, y defender los valores que nos caracterizan como una sociedad democrática.
Visión"Nuestro compromiso es preparar a los mejores profesionales, llevar a cabo investigación y divulgar el conocimiento en una universidad completa, ágil y eficiente".
![Page 6: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/6.jpg)
6
To achieve this mission, UPRM has set forth nine primary goals (Cert. # 96-97-603):
1. Have students become the central figures and “reason for being”.
2. Become an integral institution characterized by excellence in teaching, research, and service to the community.
3. Encourage an entrepreneurial spirit among students4. Internationalize the institution.5. Strengthen research and development.6. Promote complete computerization.7. Evolve into an institution that is operationally agile, efficient, and
auditable.8. Encourage close collaboration with and provide ample service
to the community.9. Establish a master plan with a focus on infrastructure and
physical equipment.
![Page 7: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/7.jpg)
7
By the time of their graduation, UPRM students will be able to:
1. Communicate effectively.2. Identify and solve problems, think critically, and
synthesize knowledge appropriate to their discipline.3. Apply mathematical reasoning skills, scientific inquiry
methods, and tools of information technology.4. Apply ethical standards.5. Recognize the Puerto Rican heritage and interpret
contemporary issues.6. Appraise the essential values of a democratic society.7. Operate in a global context, relate to a societal context,
and demonstrate respect for other cultures.8. Develop an appreciation for the arts and humanities.9. Recognize the need to engage in life-long learning.
![Page 8: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/8.jpg)
8
To accomplish our Vision/Mission…Everything we do should be:
…pertinent …coherent…strategic…dynamic …assessable
…intentionally designed!
Introduction
![Page 9: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/9.jpg)
9
Objective #1
Explain the importance and purpose of assessment.
![Page 10: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/10.jpg)
10
Assessment helps us ask ourselves..
Are we achieving our goals?
Objective #1
Are my students learning?How much are they learning?How well are they learning?What affects their learning?
Are we achieving our unit’s goals?How much are we achieving?How well are we achieving them?What affects our services?
Academically Support Units
![Page 11: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/11.jpg)
11
Assessment
…is a way of describing what we do (student learning or support services) to an identified audiencefor clearly- articulated reasons.…produces information useful for communication and decision-making.
Objective #1
![Page 12: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/12.jpg)
12
Purpose of Assessment
Assessment
Reveals the Gap
Intended Outcomes
1.
2.
3.
4.
5.
Actual Outcomes
1.
2.
3.
4.
5.
Objective #1
![Page 13: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/13.jpg)
13
Assess Learning to:
1. Provide feedback and guidance to individuals (students/employees).
2. Assist the unit members to improve programs (courses and services).
3. Assure external constituents that the institution meets its academic goals.
Objective #1
![Page 14: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/14.jpg)
14
Levels of Assessment
Institutional Goals
Unit Goals
Objectives
Deanship Goals
Objective #1
![Page 15: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/15.jpg)
15
Effective assessment…
Is directed by goalsUses multiple measuresShow student development over timeUses multiple types of information
Objective #1
![Page 16: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/16.jpg)
16
Challenges of Assessment
Motivating faculty, staff, students, administration
Needs realistic goal settingData managementDoing it for the right purposeRequires taking actionCould be costly
Objective #1
![Page 17: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/17.jpg)
17
Objective #2
Recognize accreditation standards on assessment
![Page 18: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/18.jpg)
18
MSCHE: Standard 7Institutional Assessment
The institution has developed and implemented an assessment plan and process that evaluates its overall effectiveness in:
achieving its mission and goals; implementing planning, resource allocation, and
institutional renewal processes; using institutional resources efficiently; providing
leadership and governance; providing administrative structures and services;
demonstrating institutional integrity; and assuring that institutional processes and
resources support appropriate learning and other outcomes for its students and graduates.
Objective #2
![Page 19: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/19.jpg)
19
MSCHE: Standard 14Assessment of Student Learning
Assessment of student learning demonstrates that the institution’s students have knowledge, skills, and competencies consistent with institutional goals and that students at graduation have achieved appropriate higher education goals.
Objective #2
![Page 20: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/20.jpg)
20
Other Accrediting Bodies
Business – AACSB Engineering – ABET Chemistry – Nursing Library Research grants
Objective #2
![Page 21: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/21.jpg)
21
Objective #3
• Describe the process of assessment.
![Page 22: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/22.jpg)
22
The Assessment Process
EnableAchievement of Goals
Improve Continuously
Assess
Set Goals and Design Strategies
External Reality Vision/Mission
Objective #3
![Page 23: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/23.jpg)
23
For example…in a classroom1. Establish Learning Goals:
“The student will be able to discuss the importance of assessing student learning.”
2. Identify or design enabling activities: Brief presentation on topic Brainstorming Q&A
3. Select: Indicator: “Participant will present 2 arguments pro/con of assessment w/o consulting notes.” Instrument: Focused Listing
4. Assess: List 2 arguments in favor and 2 arguments against doing assessment.
5. Measure, interpret and report results (75% - listed 2/2, 15% 1/2, 10% 2/0…)
6. Introduce change7. Revise plan (Change goal, teaching methodology, student’s preparation…)
Assurance of Learning Standards
Objective #3
![Page 24: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/24.jpg)
24
For example…in an office1. Establish Goals:
“Increase student participation in cultural activities.”2. Identify or design enabling activities:
Promotional campaign in classrooms3. Select:
Indicator: “Increase students participation in cultural activities by 20% by the end of Academic Year 2006-2007.” Assessment Instruments
Actual attendance records. - Quantitative Focus groups/Opinion survey - Qualitative
4. Assess: Measure5. Interpret and report results (75% - listed 2/2, 15% 1/2, 10% 2/0…)6. Introduce change7. Revise plan (Change goal, teaching methodology, student’s
preparation…)
Objective #3
![Page 25: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/25.jpg)
25
Objective #4
• Develop a plan to conduct assessment.
![Page 26: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/26.jpg)
26
Where to start? PLAN!Step#1 – Establish goals
• Should answer five questions:1. Are they aligned with the higher-level goals?2. What type of measure do they address?3. Are they realistic?4. Are they outcomes-based?5. Are they customer (student)-centered?
Step #2 - Identify/design activities to enable achievement of each goal.Step #3 - Select or design assessment instruments and indicators.Step #4 – AssessStep #5 – Interpret and report resultsStep #6 – Identify and introduce change strategiesStep #7 – Revise plan
Objective #4
![Page 27: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/27.jpg)
27
For example: In class
Learning Goals1. Leadership2. Critical Analysis3. Interpersonal
skills4. Team Work5. Problem Solving
Objective #4
Teaching Methodologies Lecture Case analysis and discussion Oral presentations Essays/Reports Team Projects Experiential Learning Simulations
Extracurricular Activities Seminars/forums Field trips
![Page 28: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/28.jpg)
28
For Example: In an office
Office Goals1. Increase qty/qlty2. Reduce errors3. Increase
participation4. Reduce time5. Customer service
Strategies1. Train employees2. Increase/try new
communication channels
3. Improve technology4. Re-engineer
processes5. Relocate personnel
Objective #4
![Page 29: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/29.jpg)
29
Objective #5
Identify and apply appropriate instruments to directly assess outcomes.
![Page 30: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/30.jpg)
30
Quality of outcomes is directly, although not exclusively, related to the quality of inputs.
Human behavior is goal oriented. Feedback should be received early and often. Assessment provides systematic inquiry and
challenges status quo. Assessment does not require specialized training Assessment efforts enhances performance and
personal satisfaction.
Assessment Assumptions: Objective #5
![Page 31: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/31.jpg)
31
Assessment Techniques
Learner/Customer-Centered Teacher/Management-Directed Mutually Beneficial Formative Context-Specific Ongoing Rooted in Good Teaching/Administration
Practice
Objective #5
![Page 32: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/32.jpg)
32
Classroom Assessment TechniquesObjective #5
Direct Measures 1 Minute paper Muddiest Point One-sentence summary Direct paraphrasing Application cards Empty outlines Pro-con grids Class journals/Portfolios What’s the principle? Rubrics
Indirect Measures Student evaluation of courses Alumni Feedback Internship/Coop
![Page 33: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/33.jpg)
33
Administrative Assessment
Opinion/Satisfaction surveysDaily logsAttendance recordsQuantity/quality measuresProcess analysisWorkflow analysis
Objective #5
![Page 34: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/34.jpg)
34
REMEMBER…
These ideas are suggestions to be adapted, not models to be adopted
Don’t ask if you don’t really want to know or are not going to do anything about it.
Start with something simple and then add up.
![Page 35: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/35.jpg)
35
Objective #6
Identify ways to document assessment.
![Page 36: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/36.jpg)
36
Documenting CATs
CAT’s Diagnostic Tests Pre-Post Test Muddiest Point Minute Paper Application Cards Direct Paraphrasing Course Final General
Assessment
Documentation Brief Description or
Sample copy Sample of Grades
(H,M,L) Sample Answers Analysis of Outcomes Conclusions Recommendations Actions Taken
![Page 37: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/37.jpg)
37
Documenting administrative assessment
Survey samplesDescriptive statisticsInstitutionalize it through
PublicationsRequiring it for decision makingCreate positionAssign resources
![Page 38: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/38.jpg)
38
Analysis of Outcomes
QuantitativeDescriptive statistics
Average, Median, Mode, Standard deviationQuestion by question analysis
QualitativeLook for
MisconceptionsAttitudes/prejudices
![Page 39: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/39.jpg)
39
Conclusions/Recommendations
Summarize lessons learnedList actions to be taken for improvementTAKE ACTION!!!
Refer pertinent recommendations to appropriate forum
Implement changes Assess again, and again, and again…
![Page 40: Assessment 101 (Academic and Administrative) Marta Colón de Toro, SPHR Assessment Coordinator College of Business Administration UPR-Mayagüez](https://reader036.vdocuments.us/reader036/viewer/2022062504/5a4d1b157f8b9ab059991447/html5/thumbnails/40.jpg)
40
Stages of Grieving
Denial Anger Bargaining Depression Acceptance
On Death and Dying by Elisabeth Kubler-Ross