increasing student interest and response rates
TRANSCRIPT
![Page 1: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/1.jpg)
Increasing Student Interest and Response Rates
Will Miller, Ph.D.Director of Institutional
Research and Effectiveness
![Page 2: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/2.jpg)
Flagler College• St. Augustine, FL• Approximately 2,500
students• Undergraduate only• Liberal arts tradition• Non-religious• Non-tenure system• Using IDEA since at
least 2004
![Page 3: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/3.jpg)
Old Approach to Evaluations
• Prior to Fall 2014– Veteran faculty• Select two courses (one upper/one lower)• Paper/pencil administration• One attempt—controlled by faculty
–New and adjunct faculty• All courses evaluated• Paper/pencil administration• One attempt—controlled by faculty
![Page 4: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/4.jpg)
Results with the Old Approach
• Received a high response rate given that students were a captured audience– However, there were significant administrative
costs– Concerns about faculty role in administration– Concerns about thoughtfulness of students
• Especially with written comments• Additionally, even with the high response
rate, we were only evaluating 50% of courses chosen by faculty
![Page 5: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/5.jpg)
Approach to Evaluations• Beginning in Fall 2014– All faculty• All courses evaluated• Online administration through Campus Labs• Multiple approaches
![Page 6: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/6.jpg)
Some Faculty Respond• “Students will
never take the survey online.”
• “Not every student has the capability to complete this online.”
• “They’ll all sit together and talk negatively about me.”
![Page 7: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/7.jpg)
The Response Rate Issue• Biggest concern going online• Campus-wide conversation on how
to assure response rates are where we want them to be ( > 70%)
![Page 8: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/8.jpg)
The Punitive Approach• Student can’t access grades
– Or at least not as quickly• Student can’t register for next term• Student can’t graduate
– The Bachelor of Arts degree is awarded to students who meet the following conditions:
• Faculty revolt
![Page 9: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/9.jpg)
Why We Went Another Direction
• Student Autonomy– From the moment freshmen arrive, we
preach student autonomy– Thus, it is our job to demonstrate to
them WHY they should complete course evaluations
![Page 10: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/10.jpg)
Results
![Page 11: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/11.jpg)
Results• Faculty satisfaction (and, in some
cases, lack thereof)– Comments– Response rates– Less loss of class time– Customization options
![Page 12: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/12.jpg)
Method• Faculty are told to set aside a day
and time to still complete the evaluations in class, if they wish, along with talking points– Loaner tablets available if they know
students will need them• Significant effort spent designing a
communication plan to reach ALL students
![Page 13: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/13.jpg)
Communication Plan• Pre-administration social media and
campus media blasts
![Page 14: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/14.jpg)
Communication Plan• Initial e-mail at beginning of
administration– Serious tone– Discusses importance of course
evaluations and student responsibility in completing them
– KEY: reminding them to follow faculty instruction. We leave administrations open for 2-3 weeks and allow faculty to provide guidance on timing when relevant.
![Page 15: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/15.jpg)
Sample Language• These results are used by the institution to
improve teaching and assure students are receiving the best instruction possible. Each semester IDEA results are looked at by faculty, department chairs, and administrators. Your honest feedback helps us in our efforts to continually improve instruction. Please take these evaluations seriously as they are our only opportunity to measure your satisfaction or dissatisfaction with your courses this semester.
![Page 16: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/16.jpg)
Communication Plan• Follow-up e-mails– Less serious in tone– Have faculty provide short case studies on
what they learn from IDEA results and how they’ve made positive changes (attempt to use faculty from their majors)
– Keep them updated on response rate
![Page 17: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/17.jpg)
Communication Plan• Follow-up e-mails– Sample language
• I know you’re tired of hearing from my office about these, but they really are important. It will take less than 5 minutes per course to complete and will help us do a better job teaching you effectively. We’ve extended the deadline till December 7 for you to complete these and really hope you will take the time to complete them. However, the sooner you complete them, the sooner we can stop reminding you.
• Yes, it’s us again. Looks like you still haven't completed course evaluations for the following courses: ECO 331 (A): International Economics We won't notify you anymore about this. Just reminding you that your ability to evaluate these courses will close on Sunday night at midnight. Log in now (even from a mobile device) to do your part.
![Page 18: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/18.jpg)
Communication Plan
![Page 19: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/19.jpg)
Communication Plan
![Page 20: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/20.jpg)
Communication Plan
![Page 21: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/21.jpg)
Communication Plan
![Page 22: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/22.jpg)
Tricks• Redirect to a different URL–www.flagler.edu/courseevaluations• Easier for faculty and students to remember
• Having students help in crafting messaging
• Appropriate seriousness in each message
• Subject lines of e-mails!– Pretty please! (responses and
comments)
![Page 23: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/23.jpg)
Conclusion• It IS possible to have high response
rates without taking draconian control over elements of student lives– Faculty will be happier– Students will be happier
![Page 24: Increasing Student Interest and Response Rates](https://reader036.vdocuments.us/reader036/viewer/2022070509/58a6f8061a28abc6318b4a15/html5/thumbnails/24.jpg)
Questions and Discussion