1 does cohort size matter when teaching? rodney arambewela, e john mcelvaney, leanne morris and...

11
1 Does cohort size matter when teaching? Rodney Arambewela, E John McElvaney, Leanne Morris and Prof. Greg Wood 1

Upload: kailey-solway

Post on 01-Apr-2015

213 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: 1 Does cohort size matter when teaching? Rodney Arambewela, E John McElvaney, Leanne Morris and Prof. Greg Wood 1

1

Does cohort size matter when teaching?Rodney Arambewela,E John McElvaney, Leanne Morris and Prof. Greg Wood

1

Page 2: 1 Does cohort size matter when teaching? Rodney Arambewela, E John McElvaney, Leanne Morris and Prof. Greg Wood 1

2

• Abstract • Past literature appears to support the predominant influence of the class size effect on learning.• Based on an analysis of 22,223 student grades and student evaluations in metropolitan, regional and rural

campuses of an Australian university, this study investigates the impact of class size on student engagement and student performance.

• Factors other than entry level scores, contribute to student outcomes and student engagement. • The study reveals that student satisfaction of teaching quality is higher in the rural and regional campuses where

the cohorts are smaller than at the metropolitan campus. • This may be an indication that class size seems to have a predominant influence on student engagement and

learning outcomes.•  • Field of Research: Student engagement•  • Key words: Class size, Student engagement, Student performance, Learning environment

Page 3: 1 Does cohort size matter when teaching? Rodney Arambewela, E John McElvaney, Leanne Morris and Prof. Greg Wood 1

3

Literature Review

• Biggs (1999)• Glass and Smith (1979)• Nye et al(2001)• Devlin et al (2009)• Gilbert (1995)• Ausse (2010)

Page 4: 1 Does cohort size matter when teaching? Rodney Arambewela, E John McElvaney, Leanne Morris and Prof. Greg Wood 1

4

Methodology• The research sought to examine nine core units of the Bachelor of Commerce

degree offered by The University using quantitative data obtained from The University

• The study investigated three areas:• The number of students who responded to (Student Evaluation of Teaching Units

(SETU) requests as a percentage of the total campus cohort. • The academic results of students by unit/campus and their ENTER scores. • A comparison of campus academic results with the SETU findings to determine if

there are correlations between the size of the cohort and student engagement and outcomes.

• • The study concentrated on identifying whether student engagement differs across

different cohorts at the Metro, Regional and Rural campuses.

4

Page 5: 1 Does cohort size matter when teaching? Rodney Arambewela, E John McElvaney, Leanne Morris and Prof. Greg Wood 1

5

Methodology• The base data used was:• The SETU information from Trimester 1 of 2008, 2009 and 2010. 22,223 Students

were asked to rank their agreement of comments. The specific areas of analysis from this data were:

 • Question 1. This unit was well taught. • Question 5. The teaching staff gave me helpful feedback and • Question 7. I would recommend this unit to other students.

• ENTER scores which are publically available and identify specific entry level scores for Metro, Regional and Rural for 2008 -2010.

 • Academic results. Overall student results were obtained from The University. Data

was aggregated for anonymity and there were no student identifiers, hence no ethics approval was required.

 • Limitations• Small class sizes at Rural make it difficult to generalise results, however they can

provide indicative results. A further limitation is the mix of students. Metro has a large International population and for many, English is not their first language. Both Regional and Rural have a low percentage of international students.

Page 6: 1 Does cohort size matter when teaching? Rodney Arambewela, E John McElvaney, Leanne Morris and Prof. Greg Wood 1

6

Fig 1 Student Grades and SETU data

Page 7: 1 Does cohort size matter when teaching? Rodney Arambewela, E John McElvaney, Leanne Morris and Prof. Greg Wood 1

7

Figure 2 Average Grades and SETU response rates

0%

10%

20%

30%

40%

50%

60%

0%

5%

10%

15%

20%

25%

30%

35%

Metro Regional Rural

Average

SETURespRate

%agein

grade

Average Response Rate by Grades 08-10

N P C D HD Rrate

Page 8: 1 Does cohort size matter when teaching? Rodney Arambewela, E John McElvaney, Leanne Morris and Prof. Greg Wood 1

8

Figure 3 Average responses to SETU Q1, ENTER scores and Q1 Results

0

10

20

30

40

50

60

70

80

90

3.80

3.85

3.90

3.95

4.00

4.05

Metro Regional Rural

AverageENTER score2008-2010 /

SETU Resprate

AverageSETU

meanQ1

2008-2010

AVERAGED SETU Q1 means 08-10 versus Resp Rate SETU and ENTER

SETU Q 1 Resp Rate Percent ENTER

Page 9: 1 Does cohort size matter when teaching? Rodney Arambewela, E John McElvaney, Leanne Morris and Prof. Greg Wood 1

9

Figure 4 Average Median ENTER by Campus and Grades

0

10

20

30

40

50

60

70

80

90

0%

5%

10%

15%

20%

25%

30%

35%

Metro Regional Rural

MedianENTER

average08-10

%age ingrade

Averaged Median ENTER by Grades 08-10

N P C D HD ENTER

Page 10: 1 Does cohort size matter when teaching? Rodney Arambewela, E John McElvaney, Leanne Morris and Prof. Greg Wood 1

10

Figure 5 Average SETU results by Question 1, 5 & 7, Response Rate and Campus.

0%

10%

20%

30%

40%

50%

60%

3.4

3.5

3.6

3.7

3.8

3.9

4.0

4.1

Metro Regional Rural

Average ResponseRate SETU

AverageSETUresult

Averaged SETU by Response Rates 08-10

Q 1 Q5 Q7 Rrate

Page 11: 1 Does cohort size matter when teaching? Rodney Arambewela, E John McElvaney, Leanne Morris and Prof. Greg Wood 1

11

Conclusions and Recommendations

• The comparative analysis of this research data confirmed the belief that there might be some validity to the belief that smaller class sizes produce not only greater engagement but that Regional and Rural students might appreciate and value their classes more so than their Metro counterparts.

 • The results suggest that as one moves from the larger classes of the metropolis

to the more intimate regional and rural classes, students tend to respond better to the educational experiences that they receive. This is evidenced by higher than expected academic results, higher student engagement in the unit evaluation process and satisfaction with the quality of the teaching.

• • The small numbers of students at the Rural campus is a limitation of this

research, making it difficult to generalize findings. However it appears that in respect to SETU responses the further from the Metro campus one is educated, the more students appear to value the educational experiences provided.

• Further research is required to determine whether these findings are consistent across other universities and what other factors might affect student engagement and outcomes.

•