summarizing student survey results: tips ......nsr advisory group is working on developing a...

SUMMARIZING STUDENT SURVEY RESULTS: TIPS, TEMPLATES AND TRANSPARENCY

Kim B. Kurz & Michael Kane

January 19, 2021

AGENDA

Importance

NTID Student Surveys: Types

2 Templates

10 Tips

Q&A

NTID STUDENT RATING (NSR) ADVISORY GROUP

Kim B. Kurz, CoordinatorKaren BeiterFiroza KavanaghVicki LiggeraErnest RoszkowskiDeirdre SchlehoferAndrew SteeleJennifer Verbakel

MID COURSE FEEDBACK (MCF)

• Through SRATE Office

• Qualtrics

• MyCourses survey

• Google Form survey

• In-class informal survey

STUDENT RATINGS OF TEACHING EFFECTIVENESS (SRATE)

Only for credit courses with 4 or more students

Independent Studies or non-credit courses are not included in SRATEs

STUDENT RATINGS OF TEACHING EFFECTIVENESS (SRATE)

SmartEvals provides an extensive set of tools to help faculty view and analyze the results of their surveys.

SmartEvals keeps all your historical data to help you make decisions based on trends and other indicators.

STUDENT RATINGS OF TEACHING EFFECTIVENESS (SRATE)SmartEvals=web application smartevals.com

SRATE is used every semester for every RIT course

NTID has ASL version of questions https://www.ntid.rit.edu/president/academic-affairs/srate-srs/videos-asl

Chair/Dean see ratings for core & college questions

Students & instructor see ratings for Student Government questions

SRATE SURVEY: RIT 7 SUMMATIVE QUESTIONS

SRATE SURVEY: COMMENT BOXES

SRATE SURVEY: NTID 4 SUMMATIVE QUESTIONS

SRATE SURVEY – RIT STUDENT GOVERNMENT QUESTIONS (Only Students & Faculty can see these

results)

SRATE SURVEY TIPS

Keep the same formative questions in your surveys so you can use response data from the same questions across several semesters/years to compare and document teaching improvement and changes.

Do not share ALL student evaluations IN the statements of promotion materials –best to put them in the back of your promotion portfolio as an appendice. In your promotion materials, show data in charts across the semesters/years and how it has improved so the committee can see it at one glance.

NSR advisory group is working on developing a guideline to offer ideas, suggestions and best practices to show your student evalutions in your annual appraisals and promotion materials. We welcome your ideas, input and suggestions.

SERVICES RATING SYSTEMS 1:1 (SRS)

NTID Support-Tutors

NTID Academic Advisors

NTID Speech-Language-Hearing Department

NTID Employment Center

FACULTY QUESTIONSFaculty can add up to 5 questions (Add Q’s)

Chair and dean see questions, but not results.

EACH SEMESTER- SRATE TIMELINES

Survey open for students: 4 weeks before final exams.

System sends initial e-mails and reminders.

Reports are available 2 days after final grades are due.

Reports are customizable by instructors.

CUSTOMIZE REPORT

REPORT WIZARD

CUSTOM REPORT

ANALYZING RESULTS

EXAMPLE REPORT

GREEN SHOWS MASTERY

RED NEEDS IMPROVEMENT

OPTIONAL CONFIDENCE INTERVALS

COMPARISON OPTIONS

CUSTOMIZING COLUMNS

PLAY AROUND WITH YOUR SURVEY RESULTS!

TEMPLATES & EXAMPLES WANTED!

• We are looking for different summary strategies, templates/examples of how you include in your annual appraisals or promotion materials. Please email me at Kim.Kurz@rit.edu

• Mike Kane has some great examples and templates to share with you! That is next.

TEMPLATE ANNUAL APPRAISALS

TEMPLATE ANNUAL APPRAISALS - CONTINUED

TEMPLATE PROMOTION COMMITTEES

CHART PROMOTION COMMITTEES

Column

Chart

NTID SummativeQuestion

“Satisfied with my instruction

skills”

CHART PROMOTION COMMITTEES

Combo Chart

All 4 NTIDSummative Questions

InstructorAverages

Versus

Dept - College -Campus Averages

TIP 1 CUSTOMIZE YOUR DATA

• Goal is to have your supervisor or promotion committee easily “decipher” your data … saves time for everyone’s benefit

• For guidance, ask your chair or follow written promotion policies

TIP 2 DATA COLLECTION - METHODS

EXPORTING

PROS

• Faster

• Accurate

CONS

• Can be time-consuming

• Lots of post-exporting “cleaning” up

MANUAL DATA ENTRY

PROS

• Can be relatively quick

• During data entry, issues that may arise become clearer to you

CONS

• Mistake-prone

• Need a second set of eyes to double-check accuracy

TIP 3 DIVE INTO EXCEL

• If not familiar with Microsoft Excel, ask for help – anyone at the NTID Business Studies Department will help you

• Take a self-paced tutorial via Excel Templates OR learn from a beginning Excel textbook – likely, the first or two chapters will cover everything

• 1:1 hands-on experience is encouraged - use the mouse yourself while creating a spreadsheet from scratch while with tutor offering guidance

TIP 4 EXCEL OPTIONS

• Common Excel formulas=A1-B2=A1*B2=A1/B2

• Common Excel functions=SUM =AVERAGE=COUNT

• Common Excel formattingFill (i.e., yellow, gray for highlighting)Center (i.e., headings)Font (i.e., blue, green)

TIP 5 MAINTENANCE

• Maintain data collection on a regular basis – both manual and electronic. For me, it’s every semester after final exams week

• Insert references in your summary file (i.e., ‘A’ for first semester’s SRATE survey –marked ‘A’)

• Translates to feeling less overwhelmed

TIP 6 FOUR NTID QUESTIONS

• For me, I highlight the four NTID questions/responses – unique to NTID – carried over from the former SRS system.

• My chair is fine with this approach.

• I, also, insert selected student comments that accurately reflect my teaching

TIP 7 SMARTEVALS WEBSITE

• Become familiar with “SmartEvals” website (smartevals.com)

• Be familiar, also, with expected SRATE timelines (typically, opens the first day of the 13th week of each academic term)

• Lots of tools at your disposal: viewing, exporting, manipulating, PDF, charts, data entry … play with options and reports available

TIP 8 STUDENT BUY-IN

• The more responses, the more effective those survey summaries will be.

• For example, 85% response rate > 25% response rate

• I use this flyer to promote participation (left)

TIP 9 ADDITIONAL STUDENT BUY-IN

• I show my classes the email reminders from SRATE to instructors during survey period

• I tell my students help me reach my goal of 100% response rate

• Doable since my classes are small.

TIP 10 ADDITIONAL STUDENT BUY-IN

“I’ve evaluated you now for 12 weeks with assignments, tests and grades; it’s your turn now to evaluate me.”

“You pay a lot of money for tuition, textbooks, dorm, and cafeteria. Make your voice known – express your opinions.”

“I value your opinions. I use your feedback to improve my teaching next semester.”