fossils, facies and geologic time; active learning yields - cwsei

1
Workloads & Overall Rating o Compared to other 3 rd /4 th year science courses, more balanced work loads in 2011 than 2010. AND o higher overall rating of this course in 2011 than 2010. Student perceptions of value Complete survey is fine “eosc326 survey 2011.pdfStudent engagement: o Avg lecture: 2010 ~80% 2012 ~90% Grpwork class, 2012: @30mins: ~90% @45mins: ~75% Different exams … Different results o 2010: Fewer short answer and much more poorly done o 2011: More figures, more short answer questions, AND more sophisticated student answers. o Also, Multiple choice questions were harder and more discriminating. Pedagogic choices o Precourse diagnostic + remedial content. o Text; weekly readings + online quizzes. o 2 Lectures/week with clickers. Eg. o 2 handson laboratory experiences. o 8 “active Fridays” (no lecturing) “Active Fridays” o Group work (46), worksheets, 50 minutes o Apply knowledge, practice skills, Lab followup o Enables expert novice interaction o Well liked (data to the right) Lab experiences o 150 students in 3 groups o Enables expertnovice interaction for a large class o I.D. fossil & rock samples o Analyze for genus, age, structures and environment o Construct litho& biostratigraphies o Mix of inlab, athome and inclass group work. Complexity of thinking o Before (also for labs): simpler, 3section settings. o Now: more sophisticated settings; used in class with expert guidance as clicker questions, group activities and in exam questions. Compare two 50 minute classes: o What are students doing during two types of classes? o Class observations protocol is active research in Faculty of Science, UBC (2012). Fossils, Facies and Geologic Time; Active Learning Yields More ExpertLike Thinking in a Large Class for Senior Science Students Stuart Sutherland & Francis Jones, Earth, Ocean and Atmospheric Sciences, UBC, Vancouver, BC, Canada. Contact: <[email protected]> <[email protected]> Context: Why transform this course? Initiatives: What changes were made ? Results: What evidence of improvements ? Course o eosc326, “Earth and Life Through Time”. o Elective for 150 nongeoscience B.Sc. Students o 8284% students in (2010 – 2012) are in Combined Major in Science ..or.. Life Science Mostly 3 rd and 4 th year students Younger students in 2011 and 2012. Course Level Learning Goals o Express how the concept of geological time is an important factor in our understanding of the evolution of the Earth System. o Apply basic geological principles and geoscience knowledge in the interpretation of Earth’s geological and biological history. o Describe how the biosphere has adapted to exploit various environments in the Earth's oceans over time. Before 2010, then after …. o Primarily 3 x 50 min. lectures for 13 weeks. o 2 labs introduced 2007 – refined in 2010, 2011, 2012. o Active Fridays introduced 2011 – refined in 2012. Course improvement objectives: Incorporate known “best practices” into a senior science elective for 150 students. o Have senior, nongeoscience, BSc. students study the tightly coupled geologic and biologic history of Earth using the tools and modes of thinking of experts. o Enable nonspecialists to engage in the unique aspects of geoscientific thinking. o Incorporate more active learning within class time. o Enhance the variety of ways in which students engage with new concepts and skills. o Increase individual interactions with, and feedback from, experts (instructor & TAs). o Minimize low level content delivery in lectures. o Balance the competing needs of large enrollment against the importance of the hands on experiences. AGU, December 2012 Department of Earth, Ocean & Atmospheric Sciences Science Education Initiative 0 20 40 60 80 100 120 140 1st 2nd 3rd 4th Number of student's in year Year in science degree Students by year 2010w 2011w 2012w Class & grading comparison … 2010 Labs / midterms / final 1 /1 /1 Hours: lecture / active 35 / 2 Final exam: MC / Short Ans. weights 50 / 50 Grading Scheme: - Final exam: 45% - 1 midterm 25% - 1 lab exercise 25% - clickers in class 4% - homework 1% 2011 & 2012 2 /2/1 22 / 13 40 / 60 - Final exam: 40% - 2 mid terms: 15 / 15% - 2 labs 10 / 10% - clickers in class: 3% - homework: 4% - diagnostic test: 1% - activities in class: 2% Pin exam comparisons here File “SAquestions.docx” pg1. Pin exam comparisons here File “SAquestions.docx” pg1. Pin exam comparisons here File “SAquestions.docx” pgs 2,3 Pin exam comparisons here File “SAquestions.docx” pgs 2,3 0 10 20 30 40 50 60 A B C D 4649 4044 <40 No. students in score bins Score bins 2010 scores mc2010 sa2010 0 10 20 30 40 50 60 A B C D 4649 4044 <40 No. students in score bins Score bins 2011 scores mc2011 sa2011 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% … helped you learn material for this course. … were at an appropriate level of difficulty. Working with colleagues is better than working alone. Topics were interesting. 6 activities were more worthwhile than 6 more lectures. Teaching assistants were able to provide adequate help. Pacing was appropriate given time & other constraints. You followed up on activities using given solutions. 2011: Re. Friday activities almost always often sometimes occasionally almost never Online question sets ... Number q’ns: MC / SA = 52 / 9 Scoring weights: MC / SA = 50 / 50 MC done well, SA done poorly Number q’ns: MC / SA = 40 / 15 Scoring weights: MC / SA = 40 / 60 MC / SA more similar & SA higher Number of questions as % of total number of MC q’ns, binned by avg. class score. Eg. In 2010, 12% of the questions yielded an average class score of 0 60%. These were ‘harder’ questions. 0% 10% 20% 30% 40% 50% 60% Percentage of respondents Overall rating of the course: 2010 (N=82/141) 2011 (N=98/149) 0% 5% 10% 15% 20% 25% 30% Much less A little less Roughly equal A little more Much more Percentage of all courses Compared to other courses, time you spent on 326 was ... 2010 2011 Pin lab comparisons here Pin lab comparisons here Pin lab comparisons here Pin lab comparisons here Compare 2010 / 2011 short answer questions in exams Compare 2010 / 2012 lab work Number of q’ns as % of total number of MC q’ns, binned by discrimination. Eg. in 2010, 11% of q’ns were ‘highly’ discriminating. Discrimination: listen 31% quest'n 17% pairs 4% groups 48% listen 88% pairs 12% During straight lectures During “active Fridays” 0% 10% 20% 30% 40% 50% 60% Ato A+ D to B+ Fail Proportion of all MC q'ns Average class score <‐‐ Easier qns. | Harder qns. ‐‐> 2010 2011 0% 10% 20% 30% 40% 50% 60% d1,2,3 d4,5,6 d7,8,9 Proportion of all MC qns <‐‐ lower discrim. | higher distrimin. ‐‐> 2010 2011 d = (T avg -B avg )/(T avg + B avg ); T avg [B avg ] = avg. of top [bottom] 1/3 of class. Complete survey is fine “eosc326 survey 2011.pdfAbstract Ref. #1495128, Paper# ED43B0731 Session: ED43B. Teaching About Time Posters Some pointers: Teaching activities at http://serc.carleton.edu/NAGTWorkshops/time/activities.html Eosc326 described at http://serc.carleton.edu/NAGTWorkshops/time/courses/60688.html Activity: Biozones, stratigraphic log correlation, and corresponding interpretation of paleoenvironments described at http://serc.carleton.edu/NAGTWorkshops/time/activities/61334.html. Also includes: The three page worksheet for students + Instructor's PowerPoint for running the activity + Solutions; Generic guidelines for running groupbased worksheet activities, & Worksheet timing chart.

Upload: others

Post on 10-Feb-2022

4 views

Category:

Documents


0 download

TRANSCRIPT

Workloads &  Overall Ratingo Compared to other 3rd / 4th year science courses, more balanced work loads  in 2011 than 2010.

AND o higher overall rating of this course in 2011 than 2010.

Student perceptions of value

Complete survey is fine “eosc326 survey 2011.pdf”

Student engagement:o Avg lecture:  2010 ~80%     2012 ~90%       Grp‐work class, 2012:  @30mins: ~90%    @45mins: ~75%

Different exams …Different results 

o 2010:  Fewer short answer and much more poorly done

o 2011:  More figures, more shortanswer questions, AND moresophisticated student answers.

o Also, Multiple choice questions were harder  and more discriminating.  

Pedagogic  choiceso Pre‐course  diagnostic + remedial content.o Text;  weekly readings + online quizzes.o 2 Lectures/week  with clickers.   Eg. o 2  hands‐on laboratory experiences.  o 8 “active Fridays” (no lecturing)

“Active Fridays”o Group work (4‐6), worksheets, 50 minuteso Apply knowledge, practice skills, Lab follow‐upo Enables  expert  novice interactiono Well liked (data to the right)

Lab experienceso 150 students in 3 groupso Enables expert‐novice interaction

for a large classo I.D.  fossil & rock samples o Analyze for genus, age, structures 

and environmento Construct litho‐ & bio‐stratigraphieso Mix of in‐lab,  at‐home and  in‐class group work. 

Complexity of thinkingo Before (also for labs): simpler, 3‐section settings.o Now: more sophisticated settings;  used in class

with expert guidance as clicker questions,group activities and in exam questions.

Compare two 50 minute classes:o What are students doing during  two types of classes?o Class observations protocol is active research 

in Faculty of Science, UBC (2012).

Fossils, Facies and Geologic Time; Active Learning Yields More Expert‐Like Thinking in a Large Class for Senior Science StudentsStuart Sutherland & Francis Jones,  Earth, Ocean and Atmospheric Sciences, UBC, Vancouver, BC, Canada.      Contact: <[email protected]> <[email protected]>

Context:    Why transform this course? Initiatives:    What changes were made ? Results:    What evidence of improvements ?

Courseo eosc326,  “Earth and Life Through Time”.o Elective for 150  non‐geoscience B.Sc. Studentso 82‐84% students  in (2010 – 2012) are in Combined Major in Science  ..or..   Life Science• Mostly 3rd and 4th year students• Younger students in 2011 and 2012. 

Course Level Learning Goals o Express how the concept of geological time is an important factor in our  

understanding of the evolution of the Earth System.o Apply basic geological principles and geoscience knowledge in the interpretation of 

Earth’s geological and biological history.o Describe how the biosphere has adapted to exploit various environments in the 

Earth's oceans over time.

Before 2010, then after ….o Primarily 3 x 50 min. lectures for 13 weeks.o 2  labs  introduced 2007 – refined in 2010, 2011, 2012.o Active Fridays introduced 2011 – refined in 2012. 

Course improvement objectives:Incorporate known “best practices” into a senior science elective for 150 students.o Have senior, non‐geoscience, BSc. students study the tightly coupled geologic and biologic history of Earth using the tools and modes of thinking of experts.

o Enable non‐specialists to engage in the unique aspects of geoscientific thinking.o Incorporate more active learning within class time.o Enhance the variety of ways in which students engage with new concepts and skills.o Increase individual interactions with, and feedback from, experts (instructor & TAs). o Minimize low level content delivery in lectures.o Balance the competing needs of large enrollment against the importance of the hands on experiences. 

AGU, December 2012Department of Earth, Ocean & Atmospheric Sciences

ScienceEducationInitiative

0

20

40

60

80

100

120

140

1st 2nd 3rd 4th

Numbe

r of stude

nt's in ye

ar

Year in science degree

Students by year

2010w

2011w

2012w

Class & grading comparison … 2010Labs / midterms / final 1   / 1  / 1

Hours: lecture / active 35 / 2

Final exam:  MC / Short Ans. weights 50 / 50

Grading Scheme: - Final exam: 45%- 1 midterm 25%- 1 lab exercise 25%- clickers in class 4%- homework 1%

2011  & 20122   /  2  /  1

22 / 13

40 / 60

- Final exam: 40%- 2 mid terms: 15 / 15% - 2 labs 10 / 10% - clickers in class: 3%- homework: 4%- diagnostic test: 1%- activities in class: 2%

Pin exam comparisons hereFile “SAquestions.docx” pg1.Pin exam comparisons hereFile “SAquestions.docx” pg1.

Pin exam comparisons hereFile “SAquestions.docx” pgs 2,3

Pin exam comparisons hereFile “SAquestions.docx” pgs 2,3

0

10

20

30

40

50

60

A B C D 46‐49 40‐44 <40No. stud

ents in

 score bins

Score bins

2010 scoresmc2010

sa2010

0

10

20

30

40

50

60

A B C D 46‐49 40‐44 <40No. stud

ents in

 score bins

Score bins

2011 scoresmc2011

sa2011

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

… helped you learn material for this course.

… were at an appropriate level of difficulty.

Working with colleagues is better than working alone.

Topics were interesting.

6 activities were more worthwhile than 6 more lectures.

Teaching assistants were able to provide adequate help.

Pacing was appropriate given time & other constraints.

You followed up on activities using given solutions.

2011: Re. Friday activities 

almost always often sometimes occasionally almost never

Online question sets ...

‐ Number q’ns:    MC / SA  =  52 / 9‐ Scoring weights: MC / SA  =  50 / 50‐MC done well,  SA done poorly

‐ Number q’ns:    MC / SA  =  40 / 15‐ Scoring weights: MC / SA  =  40 / 60‐ MC / SA more similar  &  SA  higher

Number of questions as % of total number of MC q’ns,  

binned by avg. class score.  

Eg.  In 2010,  12% of the questions yielded an average class score of 0 ‐ 60%.  These were ‘harder’ questions. 

0%

10%

20%

30%

40%

50%

60%

Percen

tage of respo

nden

ts

Overall rating of the course:

2010 (N=82/141)

2011 (N=98/149)

0%

5%

10%

15%

20%

25%

30%

Muchless

A littleless

Roughlyequal

A littlemore

Muchmore

Percen

tage of a

ll courses

Compared to other courses, time you spent on 326 was ... 2010

2011

Pin lab comparisons herePin lab comparisons here Pin lab comparisons herePin lab comparisons here

Compare 2010 / 2011 short answer questions in examsCompare 2010 / 2012 lab work

Number of q’ns as % of total number of MC q’ns,binned by discrimination. 

Eg. in 2010, 11% of q’ns were ‘highly’ 

discriminating.  

Discrimination:

listen31%

quest'n17%pairs

4%

groups48%

listen88%

pairs12%

During straight lectures

During “active Fridays”

0%

10%

20%

30%

40%

50%

60%

A‐ to A+ D to B+ Fail

Prop

ortio

n of all MC q'ns

Average class score<‐‐ Easier qns.  | Harder qns. ‐‐>

20102011

0%

10%

20%

30%

40%

50%

60%

d1,2,3 d4,5,6 d7,8,9

Prop

ortio

n of all MC qn

s

<‐‐ lower discrim.  | higher distrimin. ‐‐>

20102011

d = (Tavg - Bavg )/(Tavg + Bavg ); Tavg [Bavg ] = avg. of top [bottom] 1/3 of class.

Complete survey is fine “eosc326 survey 2011.pdf”

Abstract Ref. #1495128,  Paper# ED43B‐0731   Session:   ED43B. Teaching About Time Posters

Some pointers: Teaching activities at http://serc.carleton.edu/NAGTWorkshops/time/activities.htmlEosc326 described at http://serc.carleton.edu/NAGTWorkshops/time/courses/60688.htmlActivity:  Biozones, stratigraphic log correlation, and corresponding interpretation of paleoenvironments described at http://serc.carleton.edu/NAGTWorkshops/time/activities/61334.html. Also includes:  ‐ The three page worksheet for students  +  Instructor's PowerPoint for running the activity  +  Solutions;      ‐ Generic guidelines for running group‐based worksheet activities, & Worksheet timing chart.