![Page 1: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/1.jpg)
Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth
![Page 2: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/2.jpg)
Mastering's Powerful Diagnostics:
Analyze Student Performance & Use Results to
Improve Learning! Scott Hildreth - Chabot Scott Hildreth - Chabot
CollegeCollege
![Page 3: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/3.jpg)
Mastering's Powerful Diagnostics:
…and detect cheating…
Scott Hildreth - Chabot Scott Hildreth - Chabot
CollegeCollege
![Page 4: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/4.jpg)
4
A bit about me…A bit about me…
Teaching Physics & Astronomy since 1989Teaching Physics & Astronomy since 1989
Chabot College, CSU East Bay, UC BerkeleyChabot College, CSU East Bay, UC Berkeley
Astro sections ~ 50 students (3 hours/week)Astro sections ~ 50 students (3 hours/week)
Physics sections ~ 30 – 45 students (7 Physics sections ~ 30 – 45 students (7 hours/week)hours/week)
Scott Hildreth - Chabot College - April 2015
![Page 5: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/5.jpg)
5
Ways I use Ways I use Mastering…Mastering…
In PhysicsIn Physics Pre-lecture “intro” assignments ~ 1 Pre-lecture “intro” assignments ~ 1
hr/weekhr/week Traditional end-of-chapter HW ~ 3 Traditional end-of-chapter HW ~ 3
hrs/weekhrs/week Group Work in class ~ 1 hr/weekGroup Work in class ~ 1 hr/week Exam Review ~ 5 hrs/week before examsExam Review ~ 5 hrs/week before exams RemediationRemediation
Scott Hildreth - Chabot College - April 2015
![Page 6: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/6.jpg)
6
Ways I use Ways I use Mastering…Mastering…
In AstronomyIn Astronomy Weekly Reading Quizzes ~ 30 min/weekWeekly Reading Quizzes ~ 30 min/week
Weekly Homework ~ 1 hr/weekWeekly Homework ~ 1 hr/week Animated TutorialsAnimated Tutorials Reading QuestionsReading Questions Ranking TasksRanking Tasks
Exam Review ~ 1 hr/week before examsExam Review ~ 1 hr/week before exams
Scott Hildreth - Chabot College - April 2015
![Page 7: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/7.jpg)
7
An An “Aha” “Aha”
momenmomentt
Scott Hildreth - Chabot College - April 2015
Another wonderful Gary Larson Cartoon
went here! (But it is copyrighted,
and can’t be distributed over
the web.)
![Page 8: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/8.jpg)
8Scott Hildreth - Chabot College - Febrarury 2013
Mastering Captures DataMastering Captures Data
Cannon, Annie
Chandrasekhar
Einstein, Albert
Feynman, Richard
Hawking, Stephen
Herschel, Carol
Klumpke-Roberts,
Lightman, Alan
Perlmutter, Saul
Rubin, Vera
Quickly see who
is working
![Page 9: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/9.jpg)
9Scott Hildreth - Chabot College - Febrarury 2013
Mastering Captures DataMastering Captures Data
Quickly what
they miss & why
![Page 10: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/10.jpg)
10
Mastering Captures DataMastering Captures Data
Quickly see what they miss
& why
Scott Hildreth - Chabot College - April 2015
![Page 11: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/11.jpg)
11
Types of Diagnostic DataTypes of Diagnostic Data
Class-wide (scores, times, Class-wide (scores, times, difficulty)difficulty)
Scott Hildreth - Chabot College - April 2015
![Page 12: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/12.jpg)
12
Types of Diagnostic DataTypes of Diagnostic Data
Class-wide trends
Scott Hildreth - Chabot College - April 2015
Class-wide trendsClick
here…
![Page 13: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/13.jpg)
13
Types of Diagnostic DataTypes of Diagnostic Data
Assignment specific (bar Assignment specific (bar charts & histograms of charts & histograms of scores, times, difficulty)scores, times, difficulty)
Scott Hildreth - Chabot College - April 2015
![Page 14: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/14.jpg)
14
Types of Diagnostic DataTypes of Diagnostic Data
Scott Hildreth - Chabot College - April 2015
Click here…
StudentStudent
Assignment SpecificAssignment Specific
![Page 15: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/15.jpg)
15
Types of Diagnostic DataTypes of Diagnostic Data
Student specificStudent specific
Scott Hildreth - Chabot College - April 2015
![Page 16: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/16.jpg)
16
Types of Diagnostic DataTypes of Diagnostic Data
Scott Hildreth - Chabot College - April 2015
Item specific
Click here…
![Page 17: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/17.jpg)
17Scott Hildreth - Chabot College - April 2015
Comparitive Data & Errors
![Page 18: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/18.jpg)
18
What about “gaming the What about “gaming the system”system”
Student
Student
Compare Time & Score by Students
Scott Hildreth - Chabot College - April 2015
![Page 19: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/19.jpg)
19Scott Hildreth - Chabot College – April 2015
What about “gaming the What about “gaming the system”system”
Compare Time & Score by Students
![Page 20: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/20.jpg)
20Scott Hildreth - Chabot College - April 2015
What can you do with the What can you do with the data?data?
Use Diagnostic Data from HWUse Diagnostic Data from HW Change Lectures Change Lectures
““Tune” delivery to key problemsTune” delivery to key problems Focus on Common ErrorsFocus on Common Errors
Change Class FormatChange Class Format More peer learning with group workMore peer learning with group work Correlated Group Work to RetentionCorrelated Group Work to Retention
![Page 21: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/21.jpg)
21Scott Hildreth - Chabot College - Febrarury 2013
Another Another AHA AHA
moment…moment…MeasurinMeasurin
g and g and CorrelatinCorrelatin
g Datag Data
Another wonderful Gary Larson Cartoon
went here! (But it is copyrighted,
and can’t be distributed over
the web.)
![Page 22: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/22.jpg)
22Scott Hildreth - Chabot College – April 2015
Mastering Enables RAPID Mastering Enables RAPID Data AnalysisData Analysis
![Page 23: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/23.jpg)
23Scott Hildreth - Chabot College - Febrarury 2013
Mastering Enables RAPID Mastering Enables RAPID Data AnalysisData Analysis
![Page 24: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/24.jpg)
24Scott Hildreth - Chabot College - Febrarury 2013
Retrieving and Using Retrieving and Using Mastering DataMastering Data
Download Grade Book to ExcelDownload Grade Book to Excel
![Page 25: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/25.jpg)
25
Retrieving and Using Retrieving and Using Mastering DataMastering Data
Create total columns for Create total columns for assignmentsassignments
Graph totals against one anotherGraph totals against one another
Now I spend my time looking at data Now I spend my time looking at data and coming up with new ways to try and coming up with new ways to try things…things…
Scott Hildreth - Chabot College - April 2015
![Page 26: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/26.jpg)
26Scott Hildreth - Chabot College - Febrarury 2013
Fall 2012 Astro Data from Excel
![Page 27: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/27.jpg)
27Scott Hildreth - Chabot College - Febrarury 2013
Does HW improve Quiz Does HW improve Quiz Scores?Scores?
![Page 28: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/28.jpg)
28
Does Homework SuccessDoes Homework SuccessCorrelate to Exam Success?Correlate to Exam Success?
Fall 2014 Physics (Calculus-based mechanics_)
![Page 29: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/29.jpg)
29
Does Homework SuccessDoes Homework SuccessCorrelate to Exam Success?Correlate to Exam Success?
Scott Hildreth - Chabot College - April 2015
![Page 30: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/30.jpg)
30
Does Homework SuccessDoes Homework SuccessCorrelate to Exam Success?Correlate to Exam Success?
Scott Hildreth - Chabot College - April 2015
![Page 31: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/31.jpg)
31
Homework Quizzes DO Homework Quizzes DO Correlate better with ExamsCorrelate better with Exams
Scott Hildreth - Chabot College - April 2015
![Page 32: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/32.jpg)
32
Homework Quizzes DO Homework Quizzes DO Correlate better with ExamsCorrelate better with Exams
Scott Hildreth - Chabot College – April 2015
Spring 2015 1st Midterm Physics 4A
![Page 33: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/33.jpg)
33
Homework Quizzes DO Homework Quizzes DO Correlate better with ExamsCorrelate better with Exams
Scott Hildreth - Chabot College – April 2015
Spring 2015 2nd Midterm Physics 4A
![Page 34: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/34.jpg)
34
Homework Quizzes DO help Homework Quizzes DO help identify students gaming identify students gaming
the systemthe system
Scott Hildreth - Chabot College – April 2015
Good scores on
HW, Terrible on
midterm
![Page 35: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/35.jpg)
35
Homework Quizzes DO help Homework Quizzes DO help identify students gaming identify students gaming
the systemthe system
Scott Hildreth - Chabot College – April 2015
Good scores on HW,
Terrible on midterm
Actually didn’t do the HW!
![Page 36: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/36.jpg)
36
Ways I Use Mastering Ways I Use Mastering Now…Now…
Calculus-based PhysicsCalculus-based Physics HomeworkHomework
Introductory “prelecture” assignments for each chapterIntroductory “prelecture” assignments for each chapter Weekly homework assignments Weekly homework assignments HW Quiz in class to ensure students working authenticallyHW Quiz in class to ensure students working authentically
In-class collaborative In-class collaborative group workgroup work (teams) (teams) LectureLecture – doing problems together – doing problems together Exam Review Exam Review
In-class competition (teams)In-class competition (teams) Outside of class preparationOutside of class preparation
Extra CreditExtra Credit & Remedial Help & Remedial Help
Scott Hildreth - Chabot College - April 2015
![Page 37: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/37.jpg)
37
Ways I Use Mastering Ways I Use Mastering Now…Now…
Introductory AstronomyIntroductory Astronomy HomeworkHomework
Weekly homework assignments with ranking tasksWeekly homework assignments with ranking tasks Reading quizzesReading quizzes Links to additional reading, videos, and resourcesLinks to additional reading, videos, and resources
LectureLecture – doing online simulations together – doing online simulations together Exam Review Exam Review
Outside of class preparationOutside of class preparation
Extra CreditExtra Credit & Remedial Help & Remedial Help
Scott Hildreth - Chabot College - April 2015
![Page 38: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/38.jpg)
38
A quick caveat…A quick caveat…
You don’t have to do all of these at once! You don’t have to do all of these at once! Try one new thing a term…but measure it!!Try one new thing a term…but measure it!!
Scott Hildreth - Chabot College - April 2015
![Page 39: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/39.jpg)
39
Long Term Benefit: Long Term Benefit: Data!Data!
Scott Hildreth - Chabot College - April 2015
![Page 40: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/40.jpg)
40Scott Hildreth - Chabot College - Febrarury 2013
Mastering Enables Data Mastering Enables Data Analysis: Learning Analysis: Learning
OutcomesOutcomes
![Page 41: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/41.jpg)
41
Personal GoalsPersonal Goals
Track student usageTrack student usage easily easily
Take earlier, positive actionTake earlier, positive actionStudents obviously strugglingStudents obviously strugglingThose working hard, and…Those working hard, and…Those hardly working.Those hardly working.
Scott Hildreth - Chabot College - April 2015
![Page 42: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/42.jpg)
42
Current Data Analysis Current Data Analysis ProjectsProjects
Identify most-missed problems Identify most-missed problems with diagnostic datawith diagnostic data
Add messages, hints, YouTube Add messages, hints, YouTube to suggest and target student to suggest and target student thinkingthinking““online office hour” nudges…online office hour” nudges…
See if students do better See if students do better
Scott Hildreth - Chabot College - April 2015
![Page 43: Mastering’s Powerful Diagnostics: Analyze Student Performance and Use Results to Improve Learning with Scott Hildreth](https://reader035.vdocuments.us/reader035/viewer/2022062409/56649f275503460f94c3e5bd/html5/thumbnails/43.jpg)
43
Questions? Discussion?Questions? Discussion? Check out the resource list and current Check out the resource list and current
researchresearch http://www.chabotcollege.edu/faculty/shildreth/ma
stering
Login to my classes to look aroundLogin to my classes to look around Email me with questions!Email me with questions!
Images reprinted in the online presentation and available online were Images reprinted in the online presentation and available online were borrowed with permission from "e-mail.this.book", The Cartoon Bank, borrowed with permission from "e-mail.this.book", The Cartoon Bank, Alfred A. Knopf, NY, 1996. “The Far Side” comics by Gary Larson Alfred A. Knopf, NY, 1996. “The Far Side” comics by Gary Larson cannot be distributed online.cannot be distributed online.
Scott Hildreth - Chabot College - April 2015