intro clip: https:// 0zrui7rnfi
TRANSCRIPT
INTRO CLIP: HTTPS://WWW.YOUTUBE.COM/WATCH?V=80ZRUI7RNFI
Assessment: How to Start from Scratch
BY MICHELLE GESSEL & CYNTHIA WONGBRIGHAM YOUNG UNIVERSITY
"The only real stumbling block is fear of failure. In cooking you've got to have a what-the-heck attitude.“- Julia Child
Assessment Process1. Identify opportunities for assessment
2. Decide what to assess
3. Determine how to assess it
4. Carry out assessment project
5. Interpret results
6. Share results
Assessment Process – Baking a Cake
1. Identify opportunities for assessment – what are you
hoping to get out of the experience?
◦ Produce something really good
◦ Learn about the process?
◦ Improve skills?
Assessment/Baking Process
2. Decide what to assess:
◦ What do you want it to look like?
◦ How do you want to go about it?
◦ What resources are out there?
◦ Has anyone done it before?
◦ Who are you making it for?
"Cooking well doesn’t mean cooking fancy.“- Julia Child
Assessment/Baking Process
3. Determine how to assess it:
◦ How are you going to go about the process?
◦ What tools/ingredients are you going to use?
◦ How long will it take?
◦ What level of experience are you equipped to handle?
◦ How invested are you?
Assessment/Baking Process
4. Carry out assessment project
◦ What happens when things don’t go according to plan (find Julia
Child recipe where she messes up.)
◦ Are you flexible?
◦ Are you realistic?
◦ How far are you willing to deviate from the original recipe?
Assessment/Baking Process
5. Interpret results
◦ What did you learn?
◦ What are you going to do with what you learned?
◦ What would you do differently?
"The measure of achievement is not winning awards. It’s doing something that you appreciate, something you believe is worthwhile.“- Julia Child
Assessment/Baking Process
6. Share results
◦ Did we accomplish what we set out to accomplish?
◦ Did we meet expectations?
◦ What kind of feedback did we get?
◦ Did the project fulfill its purpose?
◦ Was it good?
"A party without cake is really just a meeting.“- Julia Child
Assessment Baking/Process
1. Identify opportunities for assessment
2. Decide what to assess
3. Determine how to assess it
4. Carry out assessment project
5. Interpret results
6. Share results
Preliminary Research – Researching Baking Techniques
◦ NACADA Assessment Handbook
◦ Academic Advising Approaches
◦ Experience of other advisors
1. Identifying Opportunities – Why are you baking?◦ Honors Thesis
◦ Learn more about assessment
◦ Improve my advisement center
◦ Improve my skills as an advisor
2. Decide What to Assess – What Kind of Cake
Changes in Honors Graduation Requirements
Honors Commitment Interview◦ Statement of Intent◦ Requirement Checklist◦ Goals
Research questions:◦ Is the Statement of Intent helping students reflect on their Honors
experience and find value in the program?◦ Is the Statement of Intent helping students build rapport with the
student advisor?◦ Do the students understand the requirements?
Process – Gathering Ingredients Identify Stakeholders
◦ Honors Program Administration◦ Honors Student Advisors◦ Honors Students
Determine◦ Mission◦ Vision◦ Goals
Process – Gathering Ingredients
Develop Outcomes - tools◦ Process/Delivery Outcomes – Reflect the context and
content of the advising process. Anchored in advisor.◦ Advisors are knowledgeable about Honors graduation requirements◦ Advisors are friendly and respectful toward students
◦ Student Learning Outcomes – What do we want students to learn as a result of completing the Commitment Interview?◦ Students will know what specific requirements they need to complete to
graduate with University Honors◦ Students will value their experience in the Honors Program
Process – Planning Preparation
Map Process◦ When gathered: end of commitment interview◦ Where & How Often: Advisement Center, Winter
Semester ◦ From Whom: Committed Honors Students
Determine Funding◦ Drawing for $20 gift cards to the
Bookstore for filling out survey
3. How To Assess – What Pan to Use
Ideas:◦ Rubric?
◦ E-mail survey to all Committed Honors Students?
◦ Focus Group?
Survey at end of commitment interview◦ Student
◦ Advisor
4. Carry Out Assessment Project – Baking the Cake
Train advisors
Survey at end of commitment interview
◦ both student and advisor fill out a survey
Input survey data into Qualtrics
5. Interpret Results – Deciding how to Serve
Our strong points:◦ Credit Requirement
◦ Thesis Requirement:
5. How many Honors credits do you need to take to graduate with Honors?
# Answer
Response % 1 22
0 0% 2 11
19 95% 3 14
1 5% 4 20
0 0% Total 20 100%
9. True or False: An Honors Thesis can either be original research OR a creative project.
# Answer
Response % 1 True
18 90% 2 False
2 10% Total 20 100%
5. Interpret Results, Continued
Opportunities for Improvement◦ Great Questions Essay Requirement
◦ Only 40% of students got all of them correct
8. The following assesses how well you understand the Great Questions Essay. Please check all that apply. The Great Questions Essay is:
# Answer
Response % 1 Broader than the thesis
14 70% 2 As deep and specific as the thesis
4 20% 3 10-15 pages long
1 5% 4 15-25 pages long
18 90% 5 Incorporates 5 different areas of study
1 5% 6 Incorporates 3 different areas of study
15 75% 7 The Great Question is assigned to the student
0 0% 8 The Great Question is of the student's choice
19 95% 9 You must provide a complete answer to your question
3 15% 10 Great Question Essays should be left open ended
9 45%
5. Interpret Results, Continued
What we can change:◦ Make sure advisors understand the Great Questions Essay
Requirement (quiz, ongoing training)◦ Ensure that there is clear communication between
administration and advisors on changes◦ Explain it more clearly to students◦ Develop advisement tools (handout) to simply and clearly
explain what is expected
6. Share Results – Sharing the Cake• Advisement Manager, fellow Student Advisors
• Honors Administration
• Honors Thesis
• Advisement Assessment Resources Group
• Utah Advising Association Conference
• NACADA Region 10 & NACADA National Conference
Challenges• Full time student, part time employee
• Didn’t start data collection early enough
• First time doing assessment
• Major changes in program
• Advisor turnover
Next Time I Bake• Do more preliminary research
• Start sooner
• Get more data
• Change questions
• Keep track of advisor’s scores
Questions & Discussion
Bon Appétit!
Contact info:Michelle GesselStudent AdvisorBYU Honors [email protected]
Cynthia WongAssistant Clinical ProfessorAcademic Support [email protected]
Recipe for Assessment
Ingredients:3-4 Stakeholders1 Mission statement1 VisionHandful of goals 2/3 cup Student learning outcomes1/3 cup Process and Delivery outcomesPinch of creativity1 lb. of determination Appropriate assessment tools
Instructions:Add ingredients in order and stir with assessment tool until ready to bake. Bake for at least one assessment cycle or until enough data is gathered. Let data cool until it can be interpreted effectively. For best results, serve to colleagues soon after assessment outcomes are analyzed.
Recipe for Julia Child’s Chocolate Almond Cake Ingredients: 4 ounces or squares semisweet chocolate melted2 Tb vanilla extract1/4 lb. or 1 stick softened butter2/3 cup granulated sugar3 egg yolks3 egg whitesPinch of salt1 Tb granulated sugar2/3 cup pulverized almonds1/4 tsp almond extract1/2 cup cake flour
Instructions:1. Preheat oven to 350 degrees F. Butter and flour an 8-inch round cake
pan and line with parchment paper.
2. Combine the chopped chocolate and coffee or run in a small bowl placed over a saucepan of simmering water. Stir as the chocolate melts and remove from heat as soon as it's smooth. Set aside to cool.
3. Beat the butter and 2/3 cup sugar until creamy. Add the 3 egg yolks and beat until thick. Add the cooled melted chocolate. Stir in the almond extract and almond meal/flour and mix until just combined.
4. In a separate bowl, whip the 3 egg whites and salt on high speed until foamy. Slowly add the tablespoon of sugar and whip to stiff peaks.
5. Add 1/4 of the whipped egg whites to the batter and fold gently. Add and fold in the remaining whites and the sifted cake flour.
6. Pour the batter into the prepared cake pan. Bake about 25 minutes.
7. Let cool 10 minutes, remove from pan and cool on wire racks